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Introduction 



This mini-course provides a presentation of the method of characteristics to 
initial/boundary-value problems for systems of first-order partial differential equa- 
tions and to Hamilton- Jacobi variational inequalities. 

These results are indeed useful for the treatment of hybrid systems of control 
theory. 

We use the tools forged by set-valued analysis and viability theory, which hap- 
pen to be both efficient and versatile to cover many problems. They find here an 
unexpected relevance. 

Indeed, since solutions to first-order systems 

d "9 

Vj = l,...,P, ■^u{t,x) + ^—Ui{t,x)fi{t,x,u{t,x))-gj{t,x,u{t,x)) =0 

may have "shocks", i.e., may be set-valued maps (or multi- valued maps), it seems to 
us natural to use the concept of "graphical derivative" of a set-valued map from set- 
valued analysis instead of "distributional derivative" from the theory of distributions 
to give a meaning to a concept of solution to such systems of partial differential 
equations. 

The basic concept useful in our framework is the concept of capture basin of 
a subset C under a differential equation, which is the set of points from which a 
solution to the differential equation reaches C in finite time. 

Then we shall prove that the graph of the solution (t, x) -^ U{t, x) to the above 
boundary value problem is the capture basin of the graph of the initial/boundary data 
under the characteristic system of differential equations 

t) T'{t) = -1 

ii) x'{t) = -firit),x{t),y{t))) 
III) y\t) = -g{r{t),x{t),y{t)) 

and that, under adequate assumptions, this solution is unique among the solutions 
with closed graph to this boundary value problem. 

Such a solution is thus taken in a generalized — or weak — sense (Frankowska 
solutions), since such maps, even when they are single- valued, are not differentiable 
in the usual sense. But when they are, they naturally coincide with the above 
concept of solution thanks to the uniqueness property. 

Existence and uniqueness of the solution is obtained 
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1. from a first characterization of the capture basin of C as the union of reachable 
sets -d-fitjC) := {i?_/(t, c)}cec; where 'd_f(t,c) denotes the value at time t 
of the solution to the differential equation x' = —f{x) starting at c, allowing 
explicit computations of the capture basins in specific instances, 

2. from a second characterization of the capture basin of C of a closed backward 
invariant subset M which is a repelleiQ under a differential equation x' = f{x). 
It states that the capture basin is the unique closed subset K such that 

(a) C C K C M, 

(b) K is backward invariant in the sense that any backward solution starting 
from K is viable in K, 

(c) K\C is locally viable in the sense that for any x G K\C, there exist T > 
and a solution to the differential equation starting at x viable in K\C on 
the interval [0,T], 

3. from the 1942 Nagumo Theorem stating that 

(a) the subset K is backward invariant under a differential inclusion x' = f{x) 
if and only if, for every x E K, f{x) E —Tk{x), or equivalently, if and 
only if, for every x E K, p E Nk{x), {p, f{x)) > 0, 

(b) the subset K\C is locally viable if and only if, for every x G K\C, f{x) G 
Tk{x), or equivalently, if and only if, for every x G K\C, p G Nk{x), 
{pJix))<0, 

where the "contingent cone" Tk{x) to a subset i^ at a point x E K, introduced 
in the early thirties independently by Bouligand and Severi, adapts to any 
subset the concept of tangent space to manifolds, and where the "normal 
cone" Nk{x) := Tk{x)^ , defined as the polar cone to the contingent cone, 
adapts to any subset the concept of normal space to manifolds, 

4. from the definition of the contingent derivative DU{t, x, y) of the set-valued 
map U : (t, x) -^ U{t, x) at a point (t, x, y) of the graph of U as the set-valued 
map from Hx X to Y the graph of which is the contingent cone to the graph 
of U at the point (t, x, y). 

The above results — which are interesting by themselves for other mathematical 
models of evolutionary economics, population dynamics, epidemiology — can be ap- 
plied to many other problems. Dealing with subsets, they can be applied to graphs 



^This means that all solutions to the differential equation x' = J{x) starting from M leave M 
in finite time. 
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of single-valued maps as well as set-valued maps, to epigraphs and hypographs of 
(extended) real-valued functions, to graph of "impulse" maps (which take empty 
values except in a discrete sets, useful in the study of hybrid systems or inventory 
management), etc. Since these results are also valid for underlying differential in- 
clusions, we are able to treat control problems for such boundary- value problems for 
systems of first-order partial differential equations. 

We also illustrate the strategy of using the properties of the viability kernel — the 
subset of elements from which starts at least a solution to the differential equation 
viable in i^ — and the capture basin of a subset advocated by Hlne FrankowskaQ 
for characterizing the value functions of some variational problems or stopping time 
problems as "contingent solutions" and/or "viscosity solutions to Hamilton- Jacobi 
"differential variational inequalities" 

i) u{x) < u^{x) 

zz) /^u^{x)J{x)\+l{xJ{x)) + au'{x) < 

zzi) (u(x)-uT(a;))f/^uT(x),/(x)\ + /(x,/(x)) + auT(x)j =0 

and 

i) < u^(a;) < u(x) 

a) l—u-^{x),f{x)\+l{x,f{x)) + au-^{x) > 

m) {u{x)-u^ix))(/-^u^{x)Jix)\+lixJix)) + an^ix)\ =0 

where 

1. / : R" I— > R'^ defines the dynamics of the differential equation x' = f{x), 

2. / : {x,p) G R" X R" I— > l{x,p) G R+ is a nonnegative "Lagrangian" 



," 

5 



^Helene Frankowska proved that the epigraph of the value function of an optimal control problem 
— assumed to be only lower semicontinuous — is invariant and backward viable under a (natural) 
auxiliary system. Furthermore, when it is continuous, she proved that its epigraph is viable and 
its hypograph invariant (|^, ^, ^ Frankowska]). By duality, she proved that the latter property 
is equivalent to the fact that the value function is a viscosity solution of the associated Hamilton- 



Jacobi equation in the sense of M. Crandall and P.-L. Lions. See also [19, Barron & Jensen], |17, 
Barles] and fl^, Bardi & Capuzzo-Dolcetta] for more details. Such concepts have been extended 
to solutions of systems of first-order partial differential equation without boundary conditions by 
Helene Frankowska and the author (see [pi O, ITl|, 111, E^ Aubin & Frankowska] and chapter 8 of 
Ig, Aubin]). See also ||g, 0, Aubin & Da Prato]. This point of view is used here in the case of 
boundary value problems. 
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3. u : R" 1-^ R_|_ U {+00} is an extended nonnegative function (regarded as an 
obstacle, as in unilateral mechanics). 

We shall observe that the epigraphs of the solutions are respectively the viability 
kernel and the capture basin of the epigraph of u under the map g : R" x R 1-^ R" x R 
defined by 

9{x,y) := {f{x),-ay-l{xj{x))) 

This allows us to compute the "solutions" to these Hamilton- Jacobi equations 
and to check that they are respectively defined by 

n^{x) := sup fe"*u(x(t)) + f\''^l{x{r),x\T))dT] 
t>o \ Jo J 



and 



u^(a;) := inf fe"*u(a;(t)) + / e"^/(a;(r),a;'(r))rfr) 



where a:(-) is the solution to the differential equation x' = f{x) starting at x. 

Using the fact that the contingent cone to the epigraph of an extended lower 
semi continuous function is the epigraph of its "contingent epiderivative" , the char- 
acterizations of viability kernel and capture basins in terms of tangential condi- 
tions allows to interpret these "solutions" as "contingent solutions" to the above 
Hamilton- Jacobi variational inequalities. Using the characterization in terms of 
normal cones, we obtain the equivalent interpretation of these solutions as viscosity 
solutions whenever the solution is continuous instead of being merely lower semi- 
continuous. 

This this is the reason why this mini course begins with the Nagumo Theorem 
on closed subsets viable and/or invariant under a differential equation. Next, the 
notions of the "capture basin" of a closed subset, as well as its "viability kernel" are 
characterized and linked with the Nagumo Theorem. After recalling the concepts of 
contingent epiderivative and subdifferential of an extended function, these theorems 
are used for solving some Hamilton- Jacobi variational inequalities. They are also 
used for solving initial/boundary value problems for systems of first-order partial 
differential equations. 

For the sake of simplicity, we restrict ourselves in this introductory mini-course 
to the simple case when the characteristic system is made of differential equations. 
However, the very same methods can be adapted to the case when the characteristic 
system is made of differential inclusions. Actually, the methods and the view points 
developed in these notes are more important than the examples presented here, since 
they can be easily generalized and efficiently used for solving many more difficult 
problems. 



Chapter 1 

The Nagumo Theorem 



Introduction 

This chapter is a presentation of the basic Nagumo Theorem and its corol- 
laries and consequence in the simple framework of ordinary differential equations 
x' = f{x). These results — which are interesting by themselves as mathematical 
metaphors of evolutionary economics, population dynamics, epidemiology, biologi- 
cal evolution when they are extended to differential inclusions — can be applied to 
many other problems, such as control problems and, as we shall illustrate here, can 
be used as tools for solving other mathematical problems. Dealing with subsets, 
they can be applied to graphs of single-valued maps as well as set-valued maps, 
to epigraphs and hypographs of (extended) real-valued functions, and to be used 
as versatile and efficient tools for solving systems of first-order partial differential 
equations. 

A function [0, T] 3 t ^ x{t) is said to be (locally) viable in a given subset K on 
[0, T] if, for any t G [0, T], the state x{t) remains in K. 

Therefore, if a continuous map / : R" i— > R" describes the dynamics of the 
system 

Vt>0, x\t) = f{x{t)) 

we shall say that K is viable under f if starting from any initial point of K, at least 
one solution to the differential equation is viable in K. 

The Nagumo Theorem characterizes such a viability property for any locally 
compact subset K in terms of contingent and normal cones. 

Hence, we begin by recalling the concept of contingent cones and normal cones 
to a arbitrary subset of a finite dimensional vector space. For that purpose, we start 
with the notion of upper convergence of sets introduced by Painleve: The upper limit 
of a sequence of subsets Kn C X is the set of cluster points of sequences a;„ G K^. 
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With that concept, we can define the contingent cone Tx{x) to a subset K at 
X is the upper hmit of the "difference quotients" ^^^- The normal cone Nk{x) is 
next defined as the polar cone Tk{x)^ to the contingent cone. 

The Nagumo Theorem characterizes such a viability property for any locally 
compact subset K by stating that K is viable under / if and only if 

VxeK, fix) G Tk{x) 

or, equivalent ly, if and only if 

\/xeK,ypeNK{x) {pj{x)) < o 

Since open subsets, closed subsets, intersection of open and closed subsets of R"' 
are locally compact, we shall be able to specify this theorem in each of theses cases. 

We then state and prove these viability theorems. Many proofs of viability 
theorems are now available: We chose the most elementary one (which is not the 
shortest) because it is the prototype of the extensions of the viability theorems. It 
is just a modification of the Euler method of approximating a solution by piecewise 
linear functions (polygonal lines) in order to force the solution to remain viable in 
K. 

1.1 Viability &; Invariance Properties 

Definition 1.1.1 (Viable functions) Let K be a subset of a finite dimensional 
vector-space R". We shall say that a function x{-) from [0, T] to R" is viable in K 

on [0,T] if for allte [0,T], x{t) G K. 

Let us describe the dynamics of the system by a map / from R" to R". We con- 
sider the initial value problem (or Cauchy problem) associated with the differential 
equation 

VtG[0,T], x'it) = fixit)) (1.1) 

satisfying the initial condition x(0) = Xq. 

Definition 1.1.2 (Viability Sz Invariance Properties) Let K C R". We shall 
say that K is locally viable under / if for any initial state Xq of K , there exist 
T > and a viable solution on [0,T] to differential equation ( |i. j| j starting at Xq. It 
is said to be (globally) viable under f if we can always take T = oo. 

The subset K is said to be locally invariant under / if for any initial state xq of 
K and for all solutions x(-) to differential equation ^1.1\ ) (a priori defined on W) 
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starting from xq, there exists T > such that x{-) is viable in K on [0, T] . It is said 
to be (globally) invariant under f if we can always take T = oo for all solutions. 

A subset K is a repel ler if from any initial element xq G K, all solutions to the 
differential equation ( |i.i[ ) starting at Xq & K leave K in finite time. 

Remark — We should emphasize that the concept of invariance depends upon 
the behavior of f on the domain R" outside K. But we observe that viability 
property depends only on the behavior of f on K. □ 

So, the viability property requires only the existence of at least one viable solution 
whereas the invariance property demands that all solutions, if any, are viable. 

Observe also that whenever there exists a unique solution to differential equation 
x' = f{x) starting from any initial state xq, then viability and invariance properties 
of a closed subset K are naturally equivalent. 

We shall begin by characterizing the subsets K which are viable under /. The 
idea is simple, intuitive and makes good sense: A subset K is viable under f if at 
each state x of K, the velocity f{x) is "tangent" to K at x, so to speak, for bringing 
back a solution to the differential equation inside K. 

1.2 Contingent and Normal Cones 

Limits of Sets 

Limits of sets have been introduced by Paul Painleve in 1902 without the concept of 
topology. They have been popularized by Kuratowski in his famous book ToPOLO- 
GIE and thus, often called Kuratowski lower and upper limits of sequences of sets. 
They are defined without the concept of a topology on the power space. 

Definition 1.2.1 Let (-ft'ri)nGN be a sequence of subsets of a finite dimensional vec- 
tor space X . We say that the subset 

Lim.supn-*^Kn := ix E X \ lim. ini d{x, Kn) = > 

is the upper hmit or outer limit]^ of the sequence Kn and that the subset 
Liminf„^oo-f^n := {x E X \ lim„^ooC?(a;, Kn) = 0} 

is its lower limit or inner limit. A subset K is said to be the limit or the set limit 
of the sequence Kn if 

K = Liminin^ooKn = Limsup^^^/^n =: Lim„_^oo-K'n 



^The terms outer and inner limits of sets have been proposed by R.T Rockafellar and R. Wets. 



8 Introduction 

Lower and upper limits are obviously closed. We also see at once that 

Liminf„_^oo-f^n C Limsup^^o^f^n 

and that the upper limits and lower limits of the subsets Kn and of their closures 
Kn do coincide, since d{x, Kn) = d{x, Kn). 

Any decreasing sequence of subsets Kn has a limit: 

if Kn C Km when n > m, then Lim.n^ooKn = P| Kn 

n>0 

An upper limit may be empty (no subsequence of elements x„ G Kn has a cluster 
point.) 

Concerning sequences of singletons {x„}, the set limit, when it exists, is either 
empty (the sequence of elements x„ is not converging), or is a singleton made of the 
limit of the sequence. 

It is easy to check that: 

Proposition 1.2.2 // (-ft'n)nGN is a sequence of subsets of a finite dimensional 
vector space, then Liminf„^oo-^n is the set of limits of sequences Xn G Kn and 
Liiasupn-^oo^n is the set of cluster points of sequences x„ G Kn, i.e., of limits of 
subsequences x„/ G Kn'- 

Contingent Cone 

We reformulate the definition of contingent direction to a subset of a finite dimen- 
sional vector space introduced independently by Georges Bouligand and Francesco 
Severi Q in the 30's: 

Definition 1.2.3 When K G X is a subset of a normed vector space X and when 
X G K , the set Tk{x) 

K — X 

Tk{x) := Limsup;,^o+ — — 

of contingent directions to K at x is a closed cone, called the contingent cone or 
simply, the tangent cone, to K at x. 



^The concepts of semitangenti and of corde improprie to a set at a point of its closure had 
been introduced by the Itahan geometer Francesco Severi (1879-1961) and are equivalent to the 
concepts of contingentes and paratingentes introduced independently by the French mathematician 
Georges Bouligand, slightly later. Severi explains for the second time that he had discovered these 
concepts developed by Bouligand in " suo interessante libra recente" and comments: "AlVegregio 
geometra e evidentemente sfuggito che le sue ricerche in proposito sono state iniziate un po ' piu 
tardi delle mie ... Ma non gli muovo rimprovero per questo, perche neppur io riesco a seguire con 
cura minuziosa la bibliografica e leggo piu volontieri una memoria o un libra dopo aver pensato per 
conto mio all' arg omenta." I am grateful to M. Bardi for this information about Severi. 
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Therefore, a direction f G X is contingent to K aX x if and only if 

^^,^^d{x + hv,K) ^ ^ 

h~^0+ h 

or, equivalently, if and only if there exists a sequence of elements /i„ > converging 
to and a sequence of f „ G X converging to v such that 

V n > 0, X + hnVn G K 

The lemma below shows right away why these cones will play a crucial role: they 
appear naturally whenever we wish to differentiate viable functions. 

Lemma 1.2.4 Let x{-) be a diff'erentiable viable function from [0,T] to K. Then 

VtG [0,T[, x'{t) G TK{x{t)) 

Proof — Let us consider a function x{-) viable in K. It is easy to check that a;'(0) 
belongs to the contingent cone Tk{xq) because x(h) belongs to K and consequently. 



dxixQ + hx (0)) kc(0) + /ix (0) — xi... ,, 

< converges to 

h h 

Hence x'(0) belongs to the contingent cone to K at Xq. □ 

For convex subsets K, the contingent cone coincides with the closed cone spanned 

hj K — x: 

Proposition 1.2.5 Let us assume that K is convex. Then the contingent cone 
Tk{x) to K at X is convex and 



Tk{x) = U ^ 

We shall say in this case that it is the tangent cone to the convex subset K at x. 

Proof — We begin by stating the following consequence of convexity: If < 

hi < h2, then 

K — X K — X 

/i2 hi 

because x + hiv = j^{x + h2v) + f 1 — |^ j a; belongs to K whenever x + /i2f belongs 

to K. The sequence of the subsets ^^^ being increasing, our proposition ensues. 

n 
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Definition 1.2.6 (Viability Domain) Let K be a subset of R". We shall say 
that K is a viability domain of the map f : R" i-^ R" if 

yxeK, f{x) G Tk{x) (1.2) 

We recall that a subset K C R" is locally compact if there exists r > such 
that the ball BK{xo,r) := K n {xq + rB) is compact. Closed subsets, open subsets 
and intersections of closed and open subsets of a finite dimensional vector space are 
locally compact. 

Normals 

Definition 1.2.7 The polar cone Nk{x) := {Tk{x))~ is called the normal cone to 
K at X. 

It is also called the Bouligand normal cone, or the contingent normal cone, or 
also, the sub-normal cone and more recently, the regular normal cone by R.T. Rock- 
afellar and R. Wets. In this book, only (regular) normals are used, so that we shall 
drop the adjective "regular". □ 



Lemma 1.2.8 Let K G X be a closed subset. Let y ^ K and x G Uxiy) a best 
approximation of y by elements of K : \\y — x\\ = d{y,K). Then 

Wy^K,WxeUK{y), y - x e Nk{x) 

Proof — Since x G Ylxiy) minimizes the distance z \-^ ^\\y — z|p on K, we 
deduce that 

Vt;GTx(x), < {x-y,v) 

so that y — X belongs to Tk{x)~ =: Nk{x). □ 

When K is convex, we deduce that Nk{x) is the polar cone to K — x because 
the tangent cone is spanned hy K — x: 

Theorem 1.2.9 Let K be a closed convex subset of a finite dimensional vector 
space. Then 

p G Nk{x) if and only if ^ y E K, {p, y) < {p, x) 

and the graph of the set-valued map x -^ Nk{x) is closed in X x X*. 
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Proof — Let us consider sequences of elements Xn & K converging to x and 
Vn £ Nxixn) converging to p. Then inequalities 

WyeK, {pn,y) < {Pn,Xn) 

imply by passing to the limit inequalities 

yyeK, {p, y) < {p, x) 

which state that p belongs to Nk{x). Hence the graph is closed. □ 

In the general case, we provide now the following characterization of the normal 
cone: 

Proposition 1.2.10 Let K he a subset of a finite dimensional vector-space X . Then 
p G Nk{x) if and only 

y 6 > 0, 3t]> such that \f y E K n B{x, r]), 

(1.3) 
{p,y-x) < e\\y-x\\ 

Proof — Let p satisfy above property ( |1.3| ) and v G Tk{x). Then there exist 
hn converging to and f„ converging to v such that 

y ■= x + hnVn G KnB{x,r]) 

for n large enough. Consequently, inequalities {p, f„) < e imply by taking the limit 
that {p, v) < e for all e > 0. Hence (p, v) < 0, so that any element p satisfying the 
above property belongs to the polar cone of Tk{x). 

Conversely, assume that p violates property (|1.3| ): There exist e > and a 
sequence of elements Xn E K converging to x such that 

We set hn := ||x„ — a;||, which converges to 0, and f„ := {xn — x)/hn. These elements 
belonging to the unit sphere, a subsequence (again denoted) f„ converges to some v. 
By definition, this limit belongs to Tk{x), so that {p,v) < 0. But our choice implies 
that {p, Vn) > £, so that {p, v) > e, a. contradiction. □ 

We provide a useful characterization by duality of viability domains in terms of 
normal cones: 

Theorem 1.2.11 Let K be a locally compact subset of a finite dimensional vector 
space R" and f : K \-^ IV^ be a continuous single-valued map. Then 

WxeK, fix) G Tk{x) (1.4) 



12 Introduction 

if and only if 

\/xeK, f{x) e co(Tx(a;)) (1.5) 

or, equivalently, in terms of normal cone, if and only if 

^xeK, ypeNKix), {p,f{x)) < 

Proof — Since the normal cone Nk{x) is the polar cone to Tk{x), and thus, 
to co(Tk{x)), then co(Tft-(a;)) is the polar cone to Nk{x), so that the two last 
statements are equivalent by polarity. Since the first statement implies the second 
one, it remains to prove that if for any x E K, f{x) belongs to co(Tk{x)), then f{x) 
is actually contingent to -ft' at a; for any x & K. This follows from the following 

Lemma 1.2.12 Let K C R" he a locally compact subset of a finite dimensional 
vector space R" and f : K \-^ R" be a continuous single-valued map. Assume that 
there exists a > such that 

M X e KnB{xQ,a), f{x) G co(Tx(a;)) 

Then, f{x) is contingent to K at elements x of a neighborhood of xq. Actually, for 
any e > 0, there exists ri{xo,e) g]0, a] such that 

\/xeB{xo,v{xo,e)),^h<r^{xo,e), d (^/(x), "^^"^ ^ ^^"^^^ ~ "^ ^ <e (1.6) 

where IlK{y) denotes the set of best approximations x E K of y, i.e., the solutions 
to \\x — y\\ = d{y, K). 

Proof — It is sufficient to check the Lemma when f{x) ^ 0. Let us set 
g{t) := -d{x + tf{x),Kf = \\x + tf{x)-Xtf 

where Xt G n/^(a; + t/(a;)) is a best approximation oix + tf{x) by elements of K. We 
take a small enough for K fl -B(xo, o) to be compact. We observe that there exists 

13 g]0,q;] such that for all x G B{xq,P), ||/(a;)|| < 2||/(a;o)|| because / is continuous 
at Xq. Furthermore, 

\\x + tf{x)-xt\\ = d{x + tf{x),K) < t\\f{x)\\ < 2t\\f{xo)\\ 

because x belongs to -ft' fl B{xo,P), so that ||a; — Xt\\ < 2t||/(a;)|| < 4t||/(a;o)|| 
converges to with t. 

On the other hand, for every v^ G Txi^Xt), there exists a sequence of /i„ > 
converging to and v^ converging to Vt such that Xt + hnV^ belongs to K. Therefore, 

g{t + hn)-git) < -[\\x + tf{x)-xt + hnifix)-v]^)f-\\x + tf{x)-xtf) 
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and thus, dividing by /;,„ > and letting /i„ converge to 0, that 

^ VteTxixt), g'{t) < {x + tf{x) -xt,f{x) -vt) 

Since it is true for any Vf G Tx{xt) and since the right-hand side is affine with respect 
to Vt, we deduce that this inequahty remains true for any Vt G co(TK{xt)) , and thus, 
by assumption, for f{xt) G co(Tft-(a;()): 

g'it) < (:r + t/(x)-x„/(x)-/(x,)) <2t||/(a;o)||(||/(x)-/(xo)|| + ||/(a;o)-/(x,)||) 

For any e, let 7 > such that \\f\y) - /(a;o)|| < slL/fel ^'^^'^^^^^ V ^ B{xo,2'j). 
Since ||a;o— a;(|| < ||a; — xqH +4t||/(a;o)|| < 27 whenever ||a; — xqH < 7 and t < ^n .7 -.n , 
then, setting ri{xQ, e) := min (7, ^..J ... j, we obtain 

VxeKnB{xo,r]{xo,e)),yte]0,r]{xo,e)], g'{t) < ^-e^ (1.7) 

Therefore, after integration from to /i, we obtain 

V/iG [0, 77(^0, £)], g{h)-g{<d) < h'e' 

Observing that g{0) = 0, we derive the conclusion of the Lemma: V x/^ G IIk{x + 
hfix)), 

f UKJx + hfjx)) -x \ \\x + hf{x) -XhW _ d{x + hf{x),K) 

'^y^''^' h ) - h ~ h - ' 

1.3 Statement of the Viability Theorems 

Nagumo was the first one to prove the viability theorem for ordinary differential 
equations in 1942. This theorem was apparently forgotten, for it was rediscovered 
many times during the next twenty years. 

We shall prove it when the subset K C R" is locally compact: 

Theorem 1.3.1 (Nagumo) Let us assume that 

{i) K is locally compact . , 

ii) f is continuous from K to R" 

Then K is locally viable under f if and only if K is a viability domain of f in the 
sense that 

\/xeK, f{x) G TKix) 

or, equivalently, in terms of normal cones, 

yxeK, ypeNKix), {pj{x)) < 
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Since the contingent cone to an open subset is equal to the whole space, an open 
subset is a viability domain of any map. So, it is viable under any continuous map 
because any open subset of a finite dimensional vector space is locally compact. The 
Peano existence theorem is then a consequence of Theorem |1.3.1| . 

Theorem 1.3.2 (Peano) Let Q be an open subset of a finite dimensional vector 
space R" and f : Q \—>- R*^ be a continuous map. 

Then, for every xq G Q, there exists T > such that differential equation ( |i.i| j 
has a solution on the interval [0,T] starting at Xq- 

li C G K G R" is a closed subset of a closed subset K oi a finite dimensional 
vector space, then K\C is locally compact, because for any x G K\C, there exists 
r > such that K H B{x,r) C R"\C. On the other hand, 

\fxeK\C, Tk\c{x) = Tk{x) 

Therefore, Theorem |1.3.1| implies 



Theorem 1.3.3 Let C G K G R" is a closed subset of a closed subset K of a finite 
dimensional vector space R" and f : K\C i— >■ R" be a continuous map. Then K\C 
is locally viable under f if and only if 

yxGK\C, fix) G Tk{x) 

or, equivalently, in terms of normal cones, 

VxGi^\C, VpGiV;,(x), {p,f{x)) < 

The interesting case from the viability point of view is the one when the viability 
subset is closed. This is possible because any closed subset of a finite dimensional 
vector space is locally compact. However, in this case, we derive from Theorem |1.3.1| 
a more precise statement. 

Theorem 1.3.4 (Viability) Let us consider a closed subset K of a finite dimen- 
sional vector space R" and a continuous map f from K to R"". Then K is locally 
viable under f if and only if 

\/xGK, f{x) G Tk{x) 

If such is the case, then for every initial state Xq G K, there exist a positive T and 
a viable solution on [0,T[ to differential equation l \l.l\ ) starting at Xq such that 

{either T = oo {^ q\ 

or T < oo and limsupj^y_ ||a;(t)|| = oo 
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Further adequate information — a priori estimates on the growth of / — allows 
us to exclude the case when limsup^^j^^ 1 1 3^(^)11 = C)0 . 

This is the case for instance when / is bounded on K, and, in particular, when 
K is bounded. 

More generally, we can take T = oo when / enjoys linear growth: 

Theorem 1.3.5 Let us consider a subset K of a finite dimensional vector space R" 
and a map f from K to R". We assume that the map f is continuous from K to 
R", that it has linear growth in the sense that 

3c>0 such that \/ X e K, \\f{x)\\ < c(||x|| + 1) 

// 

VxeK, fix) G Tk{x) 

then K is globally viable under f : For every initial state xq G K , there exists a 
viable solution on [0, cxd] to differential equation ( |i.i[ j starting at xq and satisfying 

Vt> 0, ||x(t)|| < ||xo||e'=* + e'^*-l 

1.4 Proofs of the Viability Theorems 

We shall begin by proving Theorem [1.3.1| . The necessary condition follows from 
Lemma 11.2.4. 



For proving the sufficient condition, we begin by constructing approximate solu- 
tions by modifying the classical the Euler method to take into account the viability 
constraints, we then deduce from available estimates that a subsequence of these 
solutions converges uniformly to a limit, and finally check that this limit is a viable 
solution to differential equation ( |1 . 1| . ) 

1. — Construction of Approximate Solutions 

Since K is locally compact, there exists r > such that the ball BK{xo,r) := 
K n (a;o + rB) is compact. When C is a subset, we set 

||C|| := sup ||f II 
vec 

and 

Ko := KnB{xo,r), C := B(/(iro),l), T : 



\\C\\ 

We observe that C is bounded since Kq is compact. 

Let us consider the balls B[x,6{x^e)) defined in Lemma |1.2.12| with e := - 
The compact subset Kq can be covered by q balls i?(xj, //(xj, — )). Taking 6 :- 
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miiij^i... 577(0:4, ^) > 0, J the smallest integer larger than or equal to j and setting 
h := J < 9, we infer that 

W ^T^ Af(\ '^K{x + hf{x))-x \ 1 

VxGAo, d\f[x), < — 

\^ h j m 

Starting from xq, instead of defining recursively the sequence of elements ?/j+i := 
yj + hfiijj) as in the classical Euler method, we define recursively a sequence of 
elements 

Xj+i := Xj + huj G n_ft'(xj + hf\xj)) 

where f{xj) is replaced by uf 

Hxixj + hf(xi)) — Xj ^ ^ ,, ./ N ,, 1 

u^ e -^^-^ \^-^ ^ C C satisfies /x,- - M J < — 

for keeping the elements Xj E K. 

The elements Xj belong to Kq^ since they belong to K and 

II II ^ \ ^ II II ^ '1,11/^^11 ^ T^ll/^^ll 

i=0 

whenever j < J. We interpolate the sequence of elements Xj at the nodes jh by the 
piecewise linear functions Xm(t) defined on each interval [jh, (j + l)/i[ by 

V t G [jh, (j + l)h[, Xm{t) := Xj + {t - jh)uj 

We observe that this sequence satisfies the following estimates 

t) VtG [0,T], xUt)e B{Ko,em) 

(1.10) 

zz) VtG[0,T], ||x:„(t)|| < ||C|| 

Let us fix t G [t^,t^^[. Since ||a;m(t) — a^m(T4)ll = ^jll'^jll ^ IIC'H/'t?., and since 
{xj,Uj) belongs to i?(Graph(/), — ) by Lemma p. .2 .121 , we deduce that these functions 
are approximate solutions in the sense that 

VtG [0,r], xUt)eB{Ko,eJ 

(Lll) 
ii) VtG [0,T], {xm{t),x'^{t)) G fi(Graph(/),e^) 

where Em '■= converges to 0. 

2. — Convergence of the Approximate Solutions 
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Estimates (|1.10| ) imply that for all t G [0,T], the sequence Xm(t) remains in the 



compact subset B{Ko, 1) and that the sequence Xm{-) is equicontinuous, because 
the derivatives x^(-) are bounded. We then deduce from Ascoli's Theorem^ that 
it remains in a compact subset of the Banach space C(0,T;R"), and thus, that a 
subsequence (again denoted) Xm(-) converges uniformly to some function x(-). 

3. — The Limit is a Solution 

Condition ( |l.ll|) i) implies that 

VtG [0,T], x{t) eKo 

i.e., that x(-) is viable. 

Property (|l.ll|) ii) implies that for almost every t G [0,T], there exist Um and Vm 
converging to such that 

^m\^) / \Xm\J') "'m) ' '^m 

We thus deduce that for almost t > 0, x'^{t) converges to f{x{t)). On the other 
hand, 

Xm{t) - Xm{s) = / x'^{T)dT 



implies that x'^{t) converges almost every where to x'{t). We thus infer that x{-) is 
a solution to the differential equation. □ 



Proof of Theorem 1.3.4 — First, K is locally compact since it is closed and 



the dimension of R" is finite. 

■^ Let us recall that a subset Ti. of continuous functions of C(0, T; R") is equicontinuous if and 
only if 

Vte [0,T], Ve>0, 377 := ?7(?i:,t,e) I Vse [t-77,t + ?7], sup \\x{t) - x{s)\\ < e 

Locally Lipschitz functions with the same Lipschitz constant form an equicontinuous set of func- 
tions. In particular, a subset of differentiable functions satisfying 

sup ||a;'(t)|| < c < +CX) 

tG[0,Tl 

is equicontinuous. 

Ascoli's Theorem states that a subset Ti of functions is relatively compact in C(0,r;R") if and 
only if it is equicontinuous and satisfies 

V f e [0,T], nit) := {a;(i)}^(.)g„ is compact. 
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Second, we claim that starting from any xq, there exists a maximal solution. 
Indeed, denote by S[o^t[{xo) the set of solutions to the differential equation defined 
on[0,T[. 

We introduce the set of pairs {(T, x(-))}r>o, x()e5[oT[(a:o) ^^ which we consider 
the order relation -< defined by 

(r,x(-)) ^ (5,i/(-))if andonlyifT < S & VtG[0,T[, x{t) = y{t) 

Since every totally ordered subset has obviously a majorant, Zorn's Lemma im- 
plies that any solution y{-) G 5[o,5[(a;o) defined on some interval [0,5'[ can be ex- 
tended to a solution x(-) G 5[o,T[(a;o) defined on a maximal interval [0,T[. 

Third, we have to prove that if T is finite, we cannot have 

c := limsup ||x(t)|| < +00 

Indeed, if c < +cx), there would exist a constant rj g]0,T[ such that 

VtG [T-7],T[, \\x{t)\\ < c+1 

Since / is continuous images on the compact subset K r\ {c + 1)5, we infer that 
there exists a constant p such that for all s e\T ~ rj^T[, ||/(a;(s))|| < p. 
Therefore, for all r, cr G \T ~ rj, T[, we obtain: 

\\x{T)-x{a)\\ < r\\f{x{s))\\ds < p\T-a\ 



Hence the Cauchy criterion implies that x{t) has a limit when t — > T— . We denote 
by x{T) this limit, which belongs to K because it is closed. Equalities 

x{Tk) = Xo+ f{x{T))dT 
Jo 

imply that by letting A; — > 00, we obtain: 

X(T) = Xo+ r f{x{T))dT 

Jo 

This means that we can extend the solution up to T and even beyond, since Theo- 
rem |1.3.1| allows us to find a viable solution starting at x{T) on some interval [T, S] 



where S > T. Hence c cannot be finite. □ 

Proof of Theorem |1.3.5| — Since the growth of / is linear. 



3c>0, such that V X G R", ||/(a;)|| < c(||a;|| + 1) 
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Therefore, any solution to differential equation ( |1 . 1|) satisfies the estimate: 



\wm < c(iix(t)ii + i) 

The function t -^ ||a^(i^)|| being locally Lipschitz, it is almost everywhere differen- 
tiable. Therefore, for any t where x{t) is different from and differentiable, we 
have 



These two inequalities imply the estimates: 

||a;(t)|| < (||xo|| + l)e'=* & ||a;'(t)|| < c(||xo|| + l)e^* (1.12) 

Hence, for any T > 0, we infer that 

limsup ||x(t)|| < +00 

Theorem |1.3.4| implies that we can extend the solution on the interval [0, oo[. D 



1.5 The Solution Map 

Definition 1.5.1 (Solution Map) We denote by iS/(xo) the set of solutions to 
differential equation l \l.l\ ) and call the set-valued map Sf : x ^^ ^f{^) the solution 
map of f (or of differential inclusion (\1.^.) 



Theorem 1.5.2 Let us consider a finite dimensional vector space R" and a con- 
tinuous map / : R" i— ;> R"" with linear growth. Then the graph of the restriction 
of SjIl to any compact subset L is compact in R" x C(0, oo; R") where the space 
C(0, oo; R") is supplied with the compact convergence topology. 

Proof — We shall show that the graph of the restriction 5/|l of the solution 
map Sf to a compact subset L is compact. Let us choose a sequence of elements 
{xo^,Xn{-)) of the graph of the solution map Sf. They satisfy: 

<(t) = f{xn{t)) & a;„(0) = Xo„ G L 

A subsequence (again denoted) Xo„ converges to some Xq E L because L is compact. 
By Theorem |1.3.5| , 

Vn>0, ||a:„(t)|| < (||xoJ| + l)e^* & ||xUt)|| < c(||a;oJ| + l)e^* 
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Thus, by Ascoli's Theorem, the sequence a;„(-) is relatively compact in C(0, oo; R"). 
We deduce from this, that a subsequence (again denoted) x„(-) converges to a con- 
tinuous function x(-) uniformly on compact intervals. Therefore, passing to the limit 
in equalities 

Xm{t) = Xo^+ f{Xm{T))dT 



we deduce that x(-) is a solution to the differential equation starting at xq. □ 



1.6 Uniqueness Criteria 

Whenever there exists a unique solution to differential equation x' = f{x) starting 
from any initial state xq, then viability and invariance properties of a closed subset 
K are naturally equivalent. This is one of the motivations for providing uniqueness 
criteria. 



Definition 1.6.1 We shall say that a map f : R" t-^ R" is monotone if there exists 
there exists /i G R such that 

{f{xi) - f{x2),Xi-X2) < -fi\\xi-X2f (1.13) 

The interesting case is obtained when /i > 0. When / is Lipschitz with constant A, 
then it is monotone with /x = — A. 

Theorem 1.6.2 Let us consider a subset K of a finite dimensional vector space H"' 
and a continuous and monotone map f from R" to R". The solution to differential 
equation x' = f{x) starting from Xq is unique. If Xi{-) are two solutions to the 
differential equation x' = f{x),then 

\\xiit) - X2it)\\ < e-'''\\xi{0) - X2m\ 
Proof — Indeed, integrating the two sides of inequality 

±\\x,it) - X2it)r = 2U{x,{t))-f{x2{t)),x,{t)-X2{t)) < -2^^\\x,{t) - X2{t)r 

yields 

\\x,{t) - X2{t)f < e-2^*||xi(0)-a:2(0)|p 
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1.7 Backward Viability 

Definition 1.7.1 The subset K is locally backward viable under f if for any x & K , 

for any t > 0, there exist s G [0,t[ and a solution x(-) to differential equation ( ]i.i| j 
such that 

y T e [s,t], x{t) e K k x{t) = X 

It is (globally) backward viable if we can take s = in the above statement, and 
locally (resp. globally) backward invariant if for any x E K, for any t > 0, for all 
solutions x{-) to differential equation ( \1.I\ ), there exist s G [0,t[ such that 

y T e [s,t], x{t) e K k x(t) = X 

We now compare the invariance of a subset and the backward invariance of its 
complement: 

Lemma 1.7.2 A subset K is invariant under a map f if and only if its complement 
K'^ := R"\ii" is backward invariant under f . 

Proof — To say that K is not invariant under / amounts to saying that there 
exist a solution x(-) to differential equation ( |1.1D and T > such that 

x(0) G KkxiT) G YC\K 

and to say that 'Rr'\K is not backward invariant amounts to saying that there exist 
a solution y{-) to differential equation ( p..l| ), T > and 5* G [0,T[ such that 

y{S) e Kk y{T) G R"\ir 

It is obvious that the first statement implies the second one by taking y{-) = x{-) 
and S = 0. Conversely, the second statement implies the first one by taking x{t) := 
y{t + S) and replacing T by T — S* > since x(0) = y{S) belongs to K and 
x{T -S) = y{T) belongs to R"\ir. D 

It is also useful to relate backward viability and invariance under / to viability 
and invariance under — /: 

Lemma 1.7.3 Let us assume that f is continuous with linear growth. Then K is 
locally backward viable (resp. invariant) under f if and only if f is locally viable 
(resp. invariant) under —f. 

Proof — Let us check this statement for local viability. Assume that K is locally 
backward viable and infer that K is locally invariant under — /. Indeed, let x E K. 
Then, for any T > 0, there exists S G [0,T[ and a solution x{-) to differential 
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equation ( |1 . 1|) viable in K on the interval [S, T] and satisfying x{T) = x. Let y{-) 
be a solution to the differential equation y' = —f{y) starting at y(0) = x{S). Then 
the function z{-) defined by 

_ r x{T-t) if te[0,T-S] 

^ ' \y{t + T-S) if t > T - 5 

is a solution to the differential equation z' = —f{z) starting at ^(0) = x(T) = x and 
viable in K on the interval [0, T — S]. 

Conversely, assume that K is locally viable under — / and check that K is locally 
backward invariant. Let x & K, T > and one solution x(-) to differential equation 
x' = —f{x) viable in K on [0,R] where R> 0. Let be any solution y{-) to y'(t) = 
f{y{t)) starting at x and set 

,u^ _\ x{T-t) if t G [0, T] 
^' \y{t-T) if t>T 

Hence z{-) to differential equation (|1 . 1|) satisfying x(T) = x & K and viable in K 
on the interval [S", T] where S := niax(T — i?, 0). □ 

1.8 Time-Dependent Differential Equations 

Theorem 1.8.1 Let us consider a subset K of a finite dimensional vector space R" 
and a map f from R+ x K to R". We assume that the map f is continuous from 
R+ X K to R", that it has uniform linear growth in the sense that 

3c>0 such that yt>0, xe K, ||/(t,a;)|| < c(||x|| + 1) 

// 

yt>0,y X e K, f{t,x) G Tk{x) 

then K is globally viable under f : for every initial state Xq G K , there exists a viable 
solution on [0, oo] to differential equation 

x\t) := /(t,x(t)) 

starting at xq and satisfying 

Vt> 0, ||x(t)|| < ||xo||e'=* + e'^*-l 



Assume moreover that f is uniformly monotone in the sense tha^ there exists /i G R 
such that 

{f{t,Xi) - f{t,X2),Xi-X2) < -fi\\xi - X2\\'^ (1.14) 

''The interesting case is obtained when fi > 0. When / is uniformly Lipschitz with constant A, 
then it is uniformly monotone with fi = —X. 
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Ifxi andx2 are two initial states, then the solutions Xi{-) starting from Xi, {i = 1,2), 
satisfy 

\\x^it) - X2m < e-^ixi(0)-X2(0)|| 

Proof — We deduce the first statement from the standard trick which amounts 
to observing that a solution x{-) to the time- dependent differential equation x' = 
f{t,x) starting at time from the initial state Xq if and only if (r(-),a;(-)) is a 
solution to the system of differential equations 

f ^) r'{t) = 1 

\ n) x'{t) = /(r(t),x(t)) 

starting at time from (0,a;o). The solution x(-) is viable in K under / if and only 
if {t{-),x{-)) is viable in R4. x K. By the Nagumo Theorem, this is equivalent to 
require that {l,f{t,x)) G Tn^y^xityx), i.e., that fit,x) belongs to Tk{x). 

The proof of the second statement is same than the one of Theorem [1.6.2| . □ 
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Chapter 2 

Viability Kernels and Capture 
Basins 



Introduction 



When a closed subset K is not viable under a dynamical economy, then two 
questions arise naturally: 

1. find solutions starting from K which remain viable in K as long as possible, 
hopefully, forever, 

2. and starting outside of K, find solutions which return to K as soon as possible, 
hopefully, in finite time 

Studying these questions leads to the concepts of 

1. viability kernel of a subset K under a dynamical system, as the set of elements 
of K from which starts a solution viable in K, 

2. capture basin of C, which is the set of points of K from which a solution 
reaches C in finite time, 

3. when C G K, viable- capture basin, which is the subset of points of K from 
which starts a solution reaching C before leaving K. 

25 
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We shall provide characterizations of these concepts and derive their properties 
we shall use later for solving some Hamilton- Jacobi equations and boundary-value 
problems for systems of first-order partial differential equations. For instance, if K 
is backward invariant and a repeller, the capture basin of C is the unique closed 
subset D satisfying 

i) C C D c K 

ii) yxeD\C, fix) e Td{x) 
in) W X E D, —f{x) G Td(x) 

or, equivalently, by duality, the "normal conditions" 

i) C C D C K 

ii) yxED\C,ypeND{x), {pJix)) = 
Hi) W xeD,WpeND{x), {p,f{x)) > 

2.1 Reachable, Viability and Capture Tubes 

Definition 2.1.1 Let f : R" h^ R" be a map and C C R" he a subset. The 
reachable map df{-,x) is defined by 

Va;GR", ^/(t,x) := {x{t)}^^.^^sM 
We associate with it the reachable tube t ^^ '&f{tj C) defined by 

Mt,C) := {x(t)},(.),5^(e) 
We derive the following properties: 

Proposition 2.1.2 The reachable map t -^^ '&f{t, x) enjoys the semi-group property: 
Vt,s>0, ^f{t + s,x)=^f{t,^f{s,x)). 

Furthermore, 

(^;(t,-))-^ := ^-/(t,-) 
Therefore, the subset d-f{t,C) is the subset of elements x G R" which reach the 
subset at the prescribed time t. 

If f is continuous with linear growth and K C R" is closed, the graph of the 
reachable map t ^^ ^jit, K) is closed. 

Proof — The semi-group property is obvious. Let us prove the second one: 
If y G i!}f(t,x), there exists a solution x(-) to the differential equation x' = f{x) 
starting at x such that y = x{t). We set y{s) := x(t — s) if s G [0,t] and we choose 
any solution y{-) to the differential equation y' G —f{y) starting at x at time t for 
s >t. Then such a function y{-) is a solution to the differential equation y' G —f{y) 
starting at y and satisfying y{t) = x. This shows that x G ^-fit, y). 



The last statement is a consequence of Theorem |1.3.5| . □ 
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Definition 2.1.3 Let f : R" i-^ R" be a map and C C R" he any subset. 

1. The subset Viab/(C, T) of initial states xq E C such that one solution x(-) to 
differential equation x' = f{x) starting at Xq is viable in C for all t G [0,T] is 
called the T-viability kernel and the subset Viab/(C) := Viab/(C, oo) is called 
the viability kernel of C under f . A subset C is a reseller if its viability kernel 
is empty. 

2. The subset Captj(C, T) of initial states Xq G R" such that C is reached before 
T by one solution x(-) to differential equation x' = f{x) starting at Xq is called 
the T-capture basin and 

Capt/C) := U Capt/C,T) 

is said to be the capture basin of C . 

3. When C d K, the viable-capture basin Capt^(C) of C in K by f is the set of 
initial states xq G R" from which starts at least one solution to the x' = f{x) 
viable in K until it reaches C in finite time. 

Remarks — We observe that if Ti < T2, 

Viab/(C) c Viab/(C,T2) C Viab/(C,Ti) 

n n n 

Capt/C,0) = C = Viab/(C,0) 

n n n 

Capt/C) D Capt/C,T2) D Capt/C,Ti) 

One can write 

Capt/C,T) = U ^.f{t,C) 

te[o,T] 

We point out tlie following obvious properties: 

Lemma 2.1.4 LetC d K be closed subsets. The capture basin Capt r(C) is smallest 
backward invariant containing C and Capt^ (C)\C is locally viable. The capture 
basin of any union of subsets Ci {i G /) is the union of the capture basins of the Cj. 
When C <Z K where K is assumed to be backward invariant, then the viable- capture 
basin satisfies 

Captf(C) = Capt^(C) C K 

The complement Captj^(C)\C of C in the viable- capture basin Captj^(C) is lo- 
cally viable. 
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Proof — Indeed, whenever K is backward invariant, each backward reachable set 
'&-f(t, C) is contained in K, so that 

Capt/C) = U^_/(t,C) C K 

Since the intersection of backward invariant subsets is backward invariant, the cap- 
ture basin is contained in the smallest backward invariant subset containing C. 
The semi group property implies that the capture basin, which is the union of the 
backward reachable subsets, is backward invariant. 

When C d K where K is assumed to be backward invariant, then the capture 
basin 

U^-/(t,c) 

t>o 
is contained in K. 

If X belongs to Captj {C)\C^ then there exists a solution to the differential 
equation x' = f{x) starting from x which reaches C before leaving K, and thus, 
which is viable in Captj {C)\C on some nonempty interval. □ 

Proposition 2.1.5 The viability kernel Viabf{C) of C under f is the largest subset 
of C viable under f. 

Furthermore, C\Viab/(C) is a reseller and Viab/(C)\(9C is locally backward 
invariant. 

Proof — Every subset L G C viable under / is obviously contained in the viability 
kernel Viabj(C) of C under /. 

On the other hand, if x(-) is a solution to the differential equation x' = f(x) 
viable in C, then for all t > 0, the function y{-) defined by t/(r) := x{t + r) is also 
a solution to the differential equation, starting at x{t), viable in C. 

Therefore, for any element a;o G Viab/(C), there exists a viable solution x{-) to 
the differential equation starting from Xq, and thus, for all t > 0, x{t) G Viabj(C), 
so that it is viable under /. 

Let us assume that Viabf{C)\dC is not locally backward invariant: There would 
exist X G Viabf{C)\dC, T > and a solution x{-) to the differential equation 
x' = f{x) satisfying x{T) = x such that for all S < T, there exist S' G [S,T] such 
that x{S') belong to the union of dC and of the complement of the viability kernel 
Viab/(C). Since x{T) = x does not belong to the boundary dC of C, we know that 
for S close enough to T, x{[S,T]) fl dC = 0. Hence x{S') does not belong to the 
boundary of C, so that it belongs to complement of the viability kernel Viab/(C), 
and thus, the solution x(-) starting from x{S') G Viab/(C) at time S' should leave 
C in finite time, a contradiction. □ 
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2.2 Hitting and Exit Times 

Definition 2.2.1 We say that the hitting functional (or minimal time functional^ 

associating with x{-) its hitting time ujc{x{-)) is defined by 

uc{x{-)) := inf {t G [0,+oo[ | x{t) G C} 
and the function uj(j : C i-^ R+ U {+00} defined by 

Ur [x] := inf ujc{x{-)) 

is called the (lower) hitting function or minimal time function. In the same way, 
the exit functional is defined by 

Tc{x{-)) := ujn"\c{xi-)) := inf {t E [0,+oo[ | x{t) ^ C} 
and the function Tq : C ^^ R+ U {+00} defined by 

tI {x) := sup Tc{x{-)) 

x{-)€Sf{x) 

is called the (upper) exit function. 

Let C G K G R" be two closed subsets. We also introduce the function 

liKfi)^^) '■= , inf (^c(a:(-))-^/^(a^(-))) 

^ ' ' x(-)£Sf(x} 

We observe that ii C = K, ujc{x{-)) = for all solutions x{-) G Sf{x) starting 
from K and thus, that 

To say that K\C is a repeller amounts to saying that for every solution x{-) G 

Sf{x) starting from x G K\C, min{ujc{x{-),TK{x{-)))) < +00 and to say that K is 

ft 
a repeller under / amounts to saying that the exit function r^ is finite on K. 

Lemma 2.2.2 When K is closed, the exit functional tk is upper semicontinuous 
and the hitting functional ook is lower semicontinuous when C(0, 00; R") is supplied 
with the compact convergence topology. 

Proof — For proving that the exit functional tk is upper semicontinuous, 
we shall check that the subsets {x{-) \ tk{x{-)) < T} are open for the pointwise 
convergence, and thus, the compact convergence. Let xo(-) belong to such a set 
when it is not empty. Since Xq{T) does not belong K which is closed, there exist 
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a > such that B{xo(T),a) H K = (/). Then the set of continuous functions x(-) 

o 

such that x{T) EB (xo(T),a) is open and satisfy tk{x{-)) < T. 

For proving that the hitting functional is lower semicontinuous, we shall check 
that the subsets {x{-) \ uk{x{-)) < T} are closed. Let x„(-) satisfying UK{xn{-)) < T 
converge to x(-) uniformly on compact intervals. For any e > 0, one can find 
tn ^ T + e such that a;„(t„) belongs to K. A subsequence (again denoted by) tn 
converges to some t. Since x„(-) converges uniformly to x(-) on [t — e,T + e], we 
deduce that x(t) is the limit of a;„(t„) G K and thus, that x{t) belongs to the closed 
subset K and thus, that ljk{x{-j) < T + e. Letting e converge to 0, we infer that 
uJK{xi-))<T. a 

We deduce the following properties of these hitting and exit functions: 

Proposition 2.2.3 Let f : R" i-^ R" be a continuous map with linear growth and 
C G K G R" be two closed subsets. Assume that K is a repeller. 

The function 7/^ ^x is lower semicontinuous and for any x G K , there exists a 
solution X(^K,c){.') ^ '5/(x) satisfying 

In the same way, the hitting function uj^ is lower semicontinuous and the exit 
function rj^ is upper semicontinuous. Furthermore, for any x G Doin{ujj^), there 
exists one solution x^{-) G Sf{x) which hits K as soon as possible 

uJk{x) = uk{x\-)) 

and for any x G Dom(r^), there exists one solution x^{-) G Sf{x) which remains 
viable in K as long as possible: 

4\x) = tk{xK-)) 

Proof — Since the function x{-) ^^ ujc{x{-)) — tk{x{-)) is lower semicontinuous 
on C(0, 00, R") supplied with the compact convergence by Theorem |2.2.2| , we deduce 



first from Theorem |L5.2| that the infimum is reached by a solution X{^k,c){') ^ <Sf{x) 

fb 

because the set Sf{x) is compact and second, that this function Tikc) ^^ lower 

semicontinuous, by checking that the subsets {x G K \ 7(xc)(-^) — -^i ^^^ closed. 
Indeed, let us consider a sequence of elements x„ of such a subset converging to x. 
There exist solutions x„(-) G Sf{x) such that 

'l{K,C){Xn{-)) < 1[k,C)M + - <T+- 
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On the other hand, since Xn belongs to the compact ball B{x, 1), Theorem |1.5.2 
implies that a subsequence (again denoted by) x„(-) converges to some solution 
x(-) G Sf{x) uniformly on compact intervals. Since the functional '^(k,c) is lower 
semicontinuous, we infer that 

7(x,c)(3^) < l{K,c){x{-)) < hm|nf7(K,c)(a;„(-)) < T 

In particular, taking C := K, we observe that Ttj^K) ~ ~^k ■> ^^cl thus, we 
deduce the upper semicontinuity of the exit function. The same proof shows that 
the hitting function uj(j is lower semicontinuous. □ 

Viability kernels and capture basins can be characterized in terms of exit and 
hitting functionals: 

Theorem 2.2.4 /// : R" t-^ R" is continuous with linear growth andC G K G R" 
are closed subsets, then 

Captf{K,T) = lxGR''\uj(ix) < t| & Captf{K,T) = Dom(cj{-') 

Captf(C,T) = |x e R" I 7(lc)(^) < o} 

Viab/(is:,T) := {a; G R" | 4(x) > t} 

In particular, the T -viability kernels Viab/(/C, T) of a closed subset K G R", the 
T-capture basins of K under f and the viable- capture basin Captr {C,T) are closed. 

Proof — The subset of initial states x G R" such that K is reached before T 
by a solution x{-) to the differential equation x' = f{x) starting at x is obviously 

contained in the subset <xG R" | uj^ (x) < T>. 

fb 

Conversely, consider an element x satisfying uoj^ (x) < T. Hence the solution 

x^{-) G Sf{x) such that ujk{x^) = ^k{^) — ^ belongs to the T-capture basin. 

Now, to say that a solution x(-) G Sf{x) is viable in K until it reaches the target 
C means that ujc{x{-)) < tk{x{-)). Therefore, x belongs to the viable-capture basin 

Captf (C) if and only if 7/^_c)(^) ^ 0- 

The proof of the characterization of the T- viability kernel Viabj(i^, T) as upper 
sections of the exit time function r|^ is analogous. 

The topological properties then follow from the semicontinuity properties of the 



above functions stated in Proposition 2.2.3. □ 
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2.3 Characterization of the Viability Kernel 

We deduce at once the following consequence: 

Theorem 2.3.1 Let f : R" i-^ R" be a continuous map with linear growth and 
K C R" he a closed subset. Then the viability kernel is the largest closed subset 
D G K viable under f , or, equivalently, the largest closed subset of K satisfying 

\ii) WxeD, f{x) e Td{x) ^ ' 



i) D C K 

ii) \/x eD,ype Noix) {p,f{x)) < 



or, equivalently, in terms of normal cones, the largest closed subset of K satisfying 

(2.2) 

Furthermore, the viability kernel satisfies the following properties 

\/xeViabf{K)\dK, f{x) e Tviab;(x)(^) ^ -^ViabH/^)(^) 
or, equivalently, in terms of normal cones, 

VxGViab/(i^)\9ir, VpGiVviab,(x)(^)' (PJi^)) = 

Proof — The first property follows from the Nagumo Theorem characterizing 
viable subsets in terms of tangential and/or normal conditions. The second property 
translates the fact that Viabf{K)\dK is locally backward invariant, and thus, locally 
backward viable. □ 

Proposition 2.3.2 Let f : R" i-^ R" be a continuous map with linear growth and 

K C R" be a closed subset. If M G R"\Viabj(i^) is compact, then, for every 

ft 
X G M and every solution x{-) G Sf{x), there exists t G [0,sup^g^r^ (x)] such that 

x{t) i K. 



Proof — Indeed, M being compact and the exit function being upper semi 
)i 

D 



continuous, then sup^gjv// r^ [x) is finite because, for each x G M, r^ [x) is finite. 



In particular. 

Proposition 2.3.3 Let us assume that K is a compact and that f : R" i-^ R" is 
continuous with linear growth. Then either the viability kernel of K is not empty or 
K is a repeller, and in this case, T := sup^.^^^ r^ (x) is finite and satisfies 

Viabf{K,T) ^ dS k yT>T, Yiabf{K,T) = 
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Proof — When K is a repeller, the exit function is finite. Being compact, T : = 

sup^jg^ r^ (x) is thus finite and achieves its maximum at some x. By Theorem 2.2.3 , 

/•(I 

there exists a solution x(-) G Sf{x) such that tk{x{-)) = r^ (x) = T. □ 

In other words, when i^ is a compact repeller, there exists a smallest nonempty 
T- viability kernel of K, the "viability core" , so to speak, because it is the subset of 
initial states from which one solution which enjoys the longest "life expectation" T 
in K. The viability kernel, when it is nonempty, is the viability core with infinite 
life expectation. 

2.4 Characterization of Viable- Capture Basins 

Let C C K he a. closed subset of a closed subset K C R". 



Theorem 2.4.1 Let us assume that f is continuous with linear growth and that K 



is a closed repeller under f . Then the viable- capture basin Capt r (C) is the largest 



closed subset D satisfying 

i i) C C D C K 

I a) D\C is locally viable under / 

or, equivalently, is the largest closed subset D satisfying 

{ i) C C D C K 

1 ii) \/xeD\C, fix) eTD{x) 



(2.3) 



or, equivalently, in terms of normal cones, is the largest closed subset D satisfying 

l^) C C D C K 

1 u) WxeD\C,WpeND{x), {p,f{x))<0 ^ > 



Proof of Theorem |2.4.1| — Assume that a closed subset D such that 



C C -D C -RT is a repeller under / such that D\C is locally viable under / and let us 
check that it is contained in Capt^(C). Since C C Capt^(C), let x belong to D\C 
and show that it belongs to Capt^(C). Since if is a repeller, all solutions starting 
from X leave D\C in finite time. At least one of them, the solution x'*(-) G Sf{x) 
which maximizes to{x{-)): 



rlj\x) := sup r^"(x(-)) = t^\x\x)) 
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leaves D\C through C. This solution exists by Proposition p.2.3| since D is closed 
and / is continuous with linear growth. Then we claim that x" := x'^{t[) (x)) belongs 
to C. If not, D\C being locally viable, one could associate with x" G D\C a solution 
y{-) E Sf{x^) and T > such that y(r) G D\C for all r G [0,T]. Concatenating 
this solution to x^(-), we obtain a solution viable in D on an interval [0, r^, (x) +T], 
which contradicts the definition of x'^{-). Furthermore, x^{-) is viable in K since 
D C K. This implies that D C Captf (C). 

The viable-capture basin being a closed subset such that Capt^ (C)\C is locally 
viable, we conclude that it is the largest closed subset D oi K containing C such 
that D\C is locally viable under /. 

Since / is continuous and since D\C is locally compact, the Viability Theo- 
1.3.31 states that D\C is locally viable if and only if (|2.3|) ii) or (p.4|) ii) holds 



rem 



true. □ 



2.5 Characterization of Capture Basins 

Theorem 2.5.1 Let us assume that the closed subset K C R" is a repeller under f 
and backward invariant, that C d K is closed and that f is continuous with linear 
growth. 

Then the capture basin Capt r(C) is the unique closed subset D which satisfies 

i) C C D C K 

ii) D\C is locally viable under / 

Hi) D is backward invariant under / 

If we assume furthermore that f is Lipschitz, it is the unique closed subset satisfying 
the "tangential conditions" 



< 



' i) C C D c K 

li) yxeD\C, fix) G Td{x) 
Hi) W X E D, —f{x) G Td{x) 



or, equivalently, by duality, the "normal conditions" 

i) C C D C K 

ii) yxeD\C,ypeND{x), {pJix)) = 
Hi) W xeD,WpeND{x), (p,/(x)) > 

Proof — Since C G K and K is backward invariant, we already observed that 

Captf(C) = Capt/C) c K 
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Since K is a repeller, the capture basin Captj(C) is closed: For that purpose, 
let Xn € Captj(C) converge to x and infer that x belongs to the capture basin of C. 
There exist t„, and c„ := ^/(t„,x„) which belongs to C. Since i^ is a repeller, the 



-/« 



exit function rj^ is finite, and, being upper semicontinuous thanks to Lemma |2.2.2 



T := sup^^f^B{x,i) 'K (^n) < +00. Since C C K, we infer that t^ <T < +00. Hence 
we can extract a subsequence (again denoted by) t„ converging to some t G [0,T], 
so that, the reachable map being continuous, c„ converges to c = 'df{t,x) which 
belongs to C . Hence x belongs to Captj(C), which is then closed. 

Therefore, the capture basin Captj(C) is a closed subset, backward invariant 
and locally viable. 

If D is closed and backward invariant, we infer that Capt r(C) C D. By Theo- 
rem |2.4.1| , if D\C is locally viable, we know that 

Capt/C) = Captf(C) C D 

Hence, the capture basin Captj(C) is the unique closed subset, backward invariant 
and locally viable between C and K. □ 

2.6 Stability Properties 

Let us consider now a sequence of closed subsets Kn viable under a map /. Is the 
upper limit of these closed subsets still viable under f ? The answer is positive. 

Theorem 2.6.1 Let us assume that f : R" \—>- R" is continuous with linear growth. 
Then the upper limit of a sequence of subsets viable under f is still viable under f 
and the upper limit of the viability kernels of Kn is contained in the viability kernel 
of the upper limit: 

Limsup„^+o^Viab/(C„) C Viabf(Liuisup^^_^_^Cn) (2.5) 

In particular, the intersection of a decreasing family of closed viability domains 
is a closed viability domain. 

Proof — We shall prove that the upper limit K^ of a sequence of subsets K^ 
viable under / is still viable under /. 

Let X belong to KK It is the limit of a subsequence x„/ G Kn'. Since the 
subsets Kn are viable under /, there exist solutions ?/„'(■) to differential equation 
x' = f{x) starting at x„' and viable in Kn' ■ Theorem |1.5.2| implies that a subsequence 



(again denoted) yn'(') converges uniformly on compact intervals to a solution y{-) 
to differential equation x' = f{x) starting at x. Since yn'it) belongs to Kn' for all 
n', we deduce that y{t) does belong to K"^ for all t > 0. □ 
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Theorem 2.6.2 Let us consider a sequence of closed subsets Cn- 

1. If the map f is continuous with linear growth and if the subsets Cn are con- 
tained in a closed repeller K , then 

Limsup„^+<3cCaptf (C„) C Captf (Limsup,„^+<3oC„) (2.6) 

2. If the map f is furthermore monotone and K is backward invariant, then 

Capt^(Limmf„_+ooC„) C Limmf„^+ooCapt^(C„) (2.7) 

Proof — For proving inclusion ( |2.6| ), we consider the hmit x := lini„^_|_oo a;„ 



of elements Xn of Capt^ (C„). Let us consider solutions x„(-) satisfying 

tn ■■= UJcS^n{-)) < Tx(x„(-)) <T= SUp T^ (z/) 

yeB{x,l)r\K 

where T is finite because i^ is a repeller. 

Therefore, a subsequence (again denoted by) t„ converges to some t < T and 
another subsequence (again denoted by) Xn{-) converges uniformly on compact inter- 
vals to some solution x(-) starting from x. Since Xnitn) belongs to C„ and converges 
to x(t), we infer that x{t) belongs to the upper limit of the C„. Hence 

uJci{x) < lim tn < limsuprA'(xn(-)) < ^/<(a;(-)) 

and thus, x belongs to the viable-capture basin of CK 

We now prove ( ^.71 ) . Let C^ denote the lower limit of the subsets Cn and let us 
consider x an element of Captj-(C^), a solution x(-) starting from x and reaching 
C^ at time T at c := x(T). Hence y{t) := x(T — t) is a solution to the backward 
differential equation y' = —f{y) starting at c and satisfying y{T) = x. Since c = 



lim„^+oo c„ where c„ G Cn, Theorem |1.6.2| states that the solutions ?/„(■) to the 



differential equation y' = —f{y) starting from c„ satisfy 

\\y{t) ~ ynim < e-^'\\c-cn\\ 
Then Xn '■= yn{T) E Captj(C„) converges to x = yiT) E Captj(C^). □ 



Chapter 3 

Epiderivatives and Subdifferentials 



For reasons motivated by optimization theory, Lyapunov stability, control theory, 
Hamilton- Jacobi equations and mathematical morphology, the order relation on R is 
involved. This leads us to associate with an extended functions u : X i-^ RU {+cxo} 
its epigraph instead of its graph. It actually happens that the properties of the 
extended functions u : X h-^ R U {+00} are actually properties of their epigraphs. 
This "epigraphical point of view" is the key to "variational analysis" and to our 
treatment of Hamilton- Jacobi inequalities. 

In particular, one can define the following concepts: 

1. The epigraph of the lower epilimit of a sequence of extended functions u„ : 
X 1-^ R U {+00} is the upper limit of the epigraphs of the /„, 

2. The contingent epiderivative Di^u{x) at x is the lower epigraphical limit of the 
difference quotients V/iu(x), so that the epigraph of the contingent epideriva- 
tive is the contingent cone to the epigraph of u. 

By duality, the normal cones to the epigraph of an extended function yields the 
concept of subdifferential, which is in particular used in the concepts of viscosity 
solutions to Hamilton- Jacobi equations. 

3.1 Extended Functions and their Epigraphs 

A function v : X 1-^ R U {+00} is called an extended (real-valued) function. Its 
domain is the set of points at which v is finite: 

Dom(v) := {x G X | v(a;) < +00} 

A function is said to be nontrivial if its domain is not empty. Any function v defined 
on a subset K C X can be regarded as the extended function \k equal to v on X 
and to +00 outside of K, whose domain is K. 

37 
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Since the order relation on the real numbers is involved in the definition of 
the Lyapunov property (as well as in minimization problems and other dynamical 
inequalities), we no longer characterize a real- valued function by its graph, but 
rather by its epigraph indexepigraph 

Sp{^r) := {{x, A) G X X R | v(a;) < A} 

The hypograph of a function v :Xi-^RU{— 00} is defined in a symmetric way by 

nyp{\) := {{x,X) G X X R I ^r{x) > A} = -Sp{-\) 

The graph of a real-valued (finite) function is then the intersection of its epigraph 
and its hypograph. 

We also remark that some properties of a function are actually properties of 
their epigraphs. For instance, an extended function v is convex (resp. positively 
homogeneous) if and only if its epigraph is convex (resp. a cone). The epigraph of 
V is closed if and only if v is lower semicontinuous: 

V X G X, v(x) = liminfv(|/) 



y-^x 



We recall the convention inf (0) := +00. 

Lemma 3.1.1 Consider a function v : X 1-^ R U {±00}. Its epigraph is closed if 
and only if 

\/ X G X, \(x) = liminfvfa;') 



X'—fX 



Assume that the epigraph of \ is a closed cone. Then the following conditions are 
equivalent: 

i) V a; G X, v(a;) > — cxd 

ii) v(0) = 

Hi) (0,-1) i £p{\) 

Proof — Assume that the epigraph of v is closed and pick x E X. There 
exists a sequence of elements x„ converging to x such that 

lim v(a;„) = liminfv(x') 

n^oo ^ "^ x'^x ^ ' 

Hence, for any A > liminfa-/^^ v(a;'), there exist X such that, for all n > N, v(a:„) < 
A, i.e., such that {xn, A) G Sp^v). By taking the hmit, we infer that v(a;) < A, and 
thus, that \{x) < liminf^/^a; v(x'). The converse statement is obvious. 

Suppose next that the epigraph of v is a cone. Then it contains (0, 0) and 
v(0) < 0. The statements ii) and Hi) are clearly equivalent. 
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If i) holds true and v(0) < 0, then 

(0,-1) = Z^(0,v(0)) 

belongs to the epigraph of v, as well as all (0, —A), and (by letting A -^ +oo) we 
deduce that v(0) = — cxo, so that i) implies ii). 

To end the proof, assume that v(0) = and that for some x, v(x) = — oo. 
Then, for any e > 0, the pair (x, —l/e) belongs to the epigraph of v, as well as the 
pairs {ex, —1). By letting e converge to 0, we infer that (0, —1) belongs also to the 
epigraph, since it is closed. Hence v(0) < 0, a contradiction. □ 

Indicators ipK of subsets K are cost functions defined by 

iPk{x) := ii X E K and + cxd if not 

which characterize subsets (as characteristic functions do for other purposes) provide 
important examples of extended functions. It can be regarded as a membership cos^ 
to K: it costs nothing to belong to K, and +oo to step outside of K. 
Since 

Sp{ipK) = KxR+ 

we deduce that the indicator ipx is lower semicontinuous if and only if K is closed 
and that ijJk is convex if and only if K is convex. One can regard the sum v + ipx 
as the restriction of v to K. 

We recall the convention inf (0) := +cxo. 

3.2 Epilimits 

Definition 3.2.1 The epigraph of the lower epilimit limL^ooUn of a sequence of 
extended functions u„ : X h-i> R U {+c>o} is the upper limit of the epigraphs: 



£p{hm\n^ooUn) ■■= Limsup„^oo^P(un) 



The function lim-^„^ooUn whose epigraph is the lower limit of the epigraphs of the 



functions u 

is the upper epilimit of the functions u„ 
One can check that 



£p(limL_ooU„) := Liminf„^oo^p(un) 



limL^ooU„(a;o) = liminf u„(a;) 

n^oo,x—txo 



^Functions v : X >— > [0, +cxd] can be regarded as some kind of fuzzy sets, called toll sets. 
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3.3 Contingent Epiderivatives 

When u is an extended function, we associate with it its epigraph and the contingent 
cones to this epigraph. This leads to the concept of epiderivatives of extended 
functions. 

Definition 3.3.1 Let u : X i-^ R U {±00} be a nontrivial extended function and x 
belong to its domain. 

We associate with it the differential quotients 

_ / x/ X u(x + hu) — u(x) 
u '^ \/hU[x)[u) := 



h 

The contingent epiderivative D^u{x) of u at x E Dom(u) is the lower epilimit 
of its differential quotients: 

DM-) = lim«.^o+V.u(x) 

We shall say that the function u is contingently epidifferentiable at x if for any 
u E X, D^u{x){u) > —00 (or, equivalently , if D^u{x){0) = 0). 



Proposition 3.3.2 Let u : X 1— ^ R U {±00} be a nontrivial extended function and 
X belong to its domain. Then the contingent epiderivative D^u{x) satisfies 

w ^ \- n ^ V A r • f uix + hu') - uix) 

vuEX, DfU[x)[u) = limmf 

h — vO^ 11^ — i' 



and the epigraph of the contingent epiderivative D^u{-) is equal to the contingent 
cone to the epigraph of u at {x,u{x)) is 

Sp{DM-)) = T£p(u) ix,u{x)) 

Proof — The first statement is obvious. For proving the second one, we recall 
that the contingent cone 

T£p(u)(a;,u(a;)) = Limsup;,^o+ 7 

C-X^(u) — ix wix]] 

is the upper limit of the differential quotients ''- when h -^ 0+. It 

h 
is enough to observe that 

^ ,^ , ,, ^ , . „ ^ ,„ , .. Epiw) — {x,vl{x)) 
£p{DM-)):=Tepiu)ix,y) & SpiV^x)) = ^^ ^ ^ ' "^ " 
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to conclude. □ 

Consequently, the epigraph of the contingent epiderivative at x is a closed cone. It 
is then lower semicontinuous and positively homogeneous whenever u is contingently 
epidijferentiable at x. 

We observe that the contingent epiderivative of the indicator function ipK at 
X & K is the indicator of the contingent cone to K at x: 

making precise the intuition stating that the contingent cone Tk{x) plays the role 

K - X 

of a "derivative of a set", as the limit of differential quotients of sets. 

h 
The hypoderivatives of an extended function are defined in a analogous way: 

The contingent hypo derivative Diu{x) of u at x G Dom(u) is the upper hypolimit 

of its differential quotients: 

D^u{x) = lim[/j^o+V/iu(x) 

We observe that it is equal to 

u{x + hu') — u{x) 



V M G X, Diu{x){u) = limsup 

and that the hypograph of the contingent hypo derivative Z}|u(x) 0/ u at x is the 
contingent cone to the hypograph of u at {x,u{x)): 

£p{Diu{x)) = T-Hypiu) ix,u{x)) 

Definition 3.3.3 We shall say that u : X h^ W is different iable from the right at 
X if the contingent epiderivative and hypoderivative coincide: 

WveX, D^u{x){v) = Diu{x){v) 

Lemma 3.3.4 Let K G X be a closed subset andu : X 1-^ RU{+oo} be an extended 
function. We denote by u\k '■= f + 'ipK the restriction to u at K . Inequality 

D^m{x)\tk{x) < D^m\k{x) 

always holds true. It is an equality when u is differentiable from the right: the 
contingent derivative of the restriction of u to i^ is the restriction of the derivative 
to the contingent cone. 
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Proof — Indeed, let x G -ft'nDom(u). If u belongs to Tk{x), there exist /i„ -^ 0+, 
En -^ 0+ and Xn := X + hnUn G K such that 

DM^)iu) < hminf^^^^^ = lin,inf"l^(^")-"l^(") 



n^+oo fi^ n^+oo hn 



which implies the inequality. If u is different iable from the right, the differential 
quotient converges to the common value D^\i{x) = D^u\k{x) = Diu\k{x). □ 

For locally Lipschitz functions, the contingent epiderivatives are finite: 

Proposition 3.3.5 // u : X i-^ R U {+00} is Lipschitz around x G Int(Dom(u)), 
then the contingent epiderivative D^u{x) is Lipschitz: there exists A > such that 

VmGX, Dfu(x)(u) = hmmf^ ^—- < \\\u\\ 

' ^ ^^ ^ h^0+ h -MM 

Proof — Since u is Lipschitz on some ball B{x,t]), the above inequality follows 
immediately from 

„ u(x + hu) — u(x) u(x + hu') — u(x) ,, , ,,, 

n h 

by taking the liminf when h —>■ 0+ and u' ^ u. □ 

For convex functions, we obtain: 

Proposition 3.3.6 When the functionu : X 1— >• RU{+oo} is convex, the contingent 
epiderivative is equal to 

^ , s, . , ,/ , u(x + hu') — u(x)\ 
Dfu(x){u) = liminf inf ^ -^ ^^ 

"• -"• ^ ..'^.. \h>o h 



w -^u 



Proof — Indeed, Proposition |1.2.5| implies that if < /ii < /i2, 

^ /^ . NN £p(u) — (X,U(X)) ^ ,„ , ^^ 

h2 

i.e., 

V u G X, V/iiU(x)(n) < V/i2u(a;)(u) 

Therefore, 

u(x + /im) - u(a;) . u{x + hu) - u{x) 

WuEX, Du(x)(u) := hm ^ ^ —^ = mi— ^ -^ 

h^o+ h h>0 h 
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and this function Du{x) is convex with respect to u. Since the epigraph of Du{x) is 
the increasing union of the epigraphs of the differential quotients Vftu(x), we infer 
that 

D^u{x){u) := limmi Du{x){u') 

u'—>u 

We recall the following important property of convex functions defined on finite 
dimensional vector spaces: 

Theorem 3.3.7 An extended convex function u defined on a finite dimensional 
vector-space is locally Lipschitz and subdifferentiable on the interior of its domain. 
Therefore, when x belongs to the interior of the domain of u, there exists a constant 
Aa; such that 

\/u e X, Diu{x){u) = mi— / ^-- < Xx\\u\\ 

h>0 h 



The second statement follows from Proposition |3.3.5| . □ 



3.4 Generalized Gradients 

Definition 3.4.1 Let u : X i— >■ R U {+00} be a nontrivial extended function. The 
continuous linear functionals p G X* satisfying 

Vf gX, {p,v) < D^u{x){v) 

are called the (regular) subgradients of u at x, which constitute the (possibly empty) 
closed convex subset 

9_u(x) := {peX* \\/v eX, {p,v) < D^u{x){v)} 

called the (regular) sub differential of u at xq. 

In a symmetric way, the superdifferential 9+u(x) of u at x is defined by 

(9+u(a;) := —d^{—u){x) 

Naturally, when u is Frechet differentiable at x, then 

D^u{x){v) = {f'{x),v) 

so that the subdifferential d-u{x) is reduced to the gradient u'(a;). 
We observe that 

d_u{x)+NK{x) C d{u\K){x) 
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If u is differentiable at a point x & K, then the suhdifferential of the restriction 
is the sum of the gradient and the normal cone: 

9_(u|x)(x) = Vi!{x) + NK{x) 

We also note that the suhdifferential of the indicator of a subset is the normal 
cone: 

d.i,K{x) = Nk{x) 

that 

J i) {p, —1) G A^£p(u)(a^5 u(x)) if and only if p G d_u{x) 

1 ii) {p, 0) G A'£-p(u)(x, u(x)) if and only if p G Dom(L'|u(a;))~ 

so that We also deduce that 

A^£p(u)(x,u(x)) = {A(g, -l)}^ea-u(x•),A>oU{(?'0)}geDom(DTu(x))- 
The subset Doni(D|u(a;))^ = {0} whenever the domain of the contingent epideriva- 
tive D|u(x) is dense in X. This happens when u is locally Lipschitz and when the 
dimension of X is finite: 

Proposition 3.4.2 Let X be a finite dimensional vector space, u : X i-^ RU{±cxd} 
be a nontrivial extended function and Xq G Dom(u). Then the subdifferential d^u{x) 
is the set of elements p G X* satisfying 

^^.^^nix)-uix,)-{p,x-xo) ^ ^ 

is the local suhdifferential of u at a;o- 

In a symmetric way, the superdifferential 9+u(xo) of u at xq is the subset of 
elements p G X* satisfying 

u{x) -u{xo)- {p,x-xo) 
lim sup < 

x^xo \\x — Xo\\ 



Proof — This is an easy consequence of proposition |1.2.1CI| . □ 

The equivalent formulation (|3.1|) of the concept of suhdifferential has been intro- 
duced by Crandall & P.-L. Lions for defining viscosity solutions to Hamilton- Jacobi 
equations. 
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3.5 Moreau-Rockafellar SubdifFerentials 

When u is convex, the generahzed gradient coincides with the subdifferential intro- 
duced by Moreau and Rockafellar for convex functions in the early 60 's: 

Definition 3.5.1 Consider a nontrivial function u : X i-^ R U {+00} and x G 
Doni(u). The closed convex subset du{x) defined by 

du{x) = {p e X* \ "i y e X, {p,y -x) < u{y) - u{x)} 

(which may be empty) is called the Moreau-Rockafellar subdifferential o/u at x. We 
say that u is subdifferentiable at x if du{x) 7^ 0. 



Proposition L.2.9| implies that in the convex case 



Proposition 3.5.2 Let u : X 1— ^ R_|_ be a nontrivial extended convex function. 
Then the subdifferential d-u{x) coincides with Moreau-Rockafellar subdifferential 
du{x). 

Furthermore, the graph of the subdifferential map x -^^ du{x) is closed. 

Let us mention the following simple — but useful — remark: 

Proposition 3.5.3 Assume that u := v + w is the sum of a differentiable function 

V and a convex function w. If x minimizes u, then 

— v'(x) G dw{x) 
Proof — Indeed, for h > small enough, x + h{y — x) = {1 — h)x + hy so that 

u{x + h{y - x)) - u{x) u{x + h{y - x)) - u{x) , , . ,. 

< < hw(y)-w(x) 

n n 

thanks to the convexity of w. Letting h converge to yields 

< {'v'{x),y — x) +w{y) —w{x) 
so that —\'{x) belongs to dw{x). □ 
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Chapter 4 

Some Hamilton-Jacobi Equations 



Introduction 

Let us introduce 

1. a differential equation x' = f{x), where / : R" \-^ R" is continuous and has 
hnear growth, 

2. a nonnegative continuous "Lagrangian" 

/ : {x,p) G R" X R" ^ l{x,p) G R+ 

3. an extended nonnegative lower semicontinuous function u : R" i-^ R+U{+oo} 
We consider the problem 

u^(x) := aJfJu)(x) := inf [ sup ( e"*u(a;(t)) + / e"^/(a;(r),a;'(r))(ir ) ) 
^■'' ' x(-)eSf(x) \t>o \ Jo J J 

and the "stopping time" problem 

47 
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whenever the graph of the function u is regarded as an obstacle, as in unilateral 
mechanics. Taking / = 0, we obtain the a-Lyapunov function 

aJf n^ (u) (x) := inf supe"*u(a;(t)) 

as an example of the first problem and taking u = 0, we obtain the variational 
problem 

aT,)(0)(a;) := ^ mf / e^^l{x{r),x'{r))dT 

We shall prove that these functions are "generalized" solutions to Hamilton- 
Jacobi "differential variational inequalities" 

i) u{x) < u^{x) 

ii) /—u^{x),f{x)\+l{x,f{x)) + avJ{x) < 

in) {u{x) — u^ (x)) i {—u^ (x), f{x)) + l{x, f{x)) + au^ {x)\ = 

and 

i) < u^{x) < u{x) 

ii) l—u-^{x),f{x)\+l{x,f{x)) + au^{x) > 

Hi) {u{x)-u^{x))U—u^{x),fix)\ + l{x,f{x)) + au^{x)] =0 

respectively. 

For this type of partial differential equations, the concept of distributional deriva- 
tives happens to be much less adequate than other concepts of "contingent epideriva- 
tives", as it was shown by Helene Frankowska, or sub differentials, as they appear in 
the concept of "viscosity solutions" introduced by Michael Crandall and Pierre-Louis 
Lions for a general class of nonlinear Hamilton- Jacobi equations. 

Indeed, for those Hamilton- Jacobi type equations derived from the calculus of 
variations, control theory or differential games, one can derive from the properties 
of the viability kernels and capture basins of auxiliary systems that the various 
value functions involved in these problems are solutions to such Hamilton- Jacobi 
equations or differential variational inequalities in an adequate sense. 

We illustrate here this general approach for the two preceding problems only. 
Namely, we shall prove that the epigraphs of the two "value functions" u""" and u-*- 
are respectively the viability kernel and the capture basin of the epigraph of the 
function u under the map g : R" x R i-^ R" x R defined by 

9{x,y) ■■= {f{x),-ay-l{xj{x))) 
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which is a continuous map with hnear growth whenever / and the Lagrangian I 
are continuous with hnear growth. The basic observation allowing this transfer of 
properties is summarized in the statement of the following: 

Lemma 4.0.4 // a closed subset V C R" x R_|_ is locally viable under g, so is the 
epigraph of the associated extended function v : R" hH> R_,_ U {+00} defined by 

\(x) := inf y 

where we set as usual v(x) := +00 whenever the subset {y \ {x,y) G V} is empty. 
As a consequence, for any x G Dom(v), there exist a solution to the differential 
equation x' = f{x) and T > satisfying 

VtG [0,T], e"*v(x(t))+ / e^^l{x{T),x\r))dT < v(x) (4.1) 

Jo 

(where T = +00 whenever V is (globally) viable under g). 

Proof — If a; belongs to the domain of v, then (x, v(a;)) belongs to V so that 
there exist a solution x(-) G Sf{x) and T > such that 

VtG[0,T], (x{t),y{t)■=e-'''^r{x)- fe~''^'-^l{x{T),x\r))dT] gV 

i.e., if and only iiy{t) > v(x(t)), which can be written in the form ( [4.1|) . If yo > v(a;), 
then we observe that for alH > 0, 

yo{t) := e-'^'yo- f\~''^''U{x{T),x'{T))dT > y{t) > v(x(t)) 







and thus, that (a;(t),yo(^)) is a solution to the differential equation {x' (t) , y' (t)) 
g{x{t),y{t)) starting at {x,yo) and viable in the epigraph of v. □ 

4.1 Value Function 

We associate with u : R" \-^ R+ U {+c)o} the problem 

u^(x) := inf (supfe"*u(x(t))+ re""/(x(r),x'(r))drn 

xi-)€Sf{x) \t>0 \ Jo ) ) 

The function u^ := a7r^x(u) is called the value function associated with u. 
If / = 0, the above problem can be written 

a7rn>(u)(x) := inf supe'**u(x(t)) 
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and if u = 0, the above problem boils down to 



a fJO)(x) := inf / e'^"/(a;(r),x'(r))rfr 

Before investigating further these examples, we begin by characterizing the epi- 
graph of u^: 

Proposition 4.1.1 Let us assume that f and I are continuous with linear growth 
and thatvL : R*^ i-h> R+UJ+oo} is nontrivial, non negative and lower semicontinuous. 

Then the epigraph of u^ := aL^Ju) is the viability kernel Viabg{Sp{u)) of the 
epigraph of u under g . 

Consequently, the function u^ is characterized as the smallest of the lower semi- 
continuous functions v : R" i— > R U {+C)o} larger than or equal to u such that for 
any x G Dom(v), there exists a solution x{-) to the differential equation x' = f{x) 
satisfying property i\4-A)- 



Vt>0, e"*v(a;(t))+ / e''"/(x(r),x'(r))rfr < v(x) 

Jo 

Proof — Indeed, to say that a pair {x, y) belongs to the viability kernel 
Viabc,(£^p(u)) means that there exists a solution x(-) G Sf{x) such that 

Vt>0, (x{t),e-^'y- f e-^^'-U{x{T),x'{T))dT] e Sp{u) 

i.e., if and only if 

Vt>0, e"*u(x(t))+ / e""/(x(r),x'(r))rfr < y 

Jo 

This implies that 



u (x) := inf 

x{-)<=Sf{x) \t>0 



Lnp(u{x{t))+J^l{x{T),x\T))drU < y 



and thus, that Viabg(£^p(u)) is contained in £p{u^). 

Since the set Sf{x) of solutions is compact in the space C(0, oo; R") thanks to 
Theorem |1.5.2 and since the function x(-) i— » /q /(x(r), /(x(r))) is continuous on 



C(0, oo; R"), the infimum 

: sup fe'^*u(^(t)) + / e""/(x(r),x'(r))rfr 
t>o \ Jo 



U [X) 
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is reached by a solution x(-) G Sf{x). Consequently, the function 

('x(t),e-"*uT(x)- /'*e-"(*-"/(x(r),x'(r))t/r') G Spiu^) 

is viable in the epigraph of u^. Therefore, (x, u^{x)) belongs to the viability kernel 
of the epigraph of u. 

By Lemma [4.0.4| , the epigraph of u^ being the viability kernel, contains the 



epigraph of any lower semicontinuous functions v : R" i— i> RU {+C)o} larger than or 
equal to u viable under g, i.e., satisfying property (^4.1| ). Therefore, the function u^ 
is the smallest of the lower semicontinuous functions v : R" i— ;> R U {+00} larger 



than or equal to u satisfying property ( [4.1|) . □ 



Theorem 4.1.2 We posit the assumptions of Theorem \^.1.]\ . Then the value func- 
tion u^ is characterized as the smallest of the nonnegative lower semicontinuous 
functions v : R" 1-^ R U {+C)o} satisfying for every x 

j i) vl{x) < \{x) 

\ii) D^^{x){f{x)) + l{xJ{x)) + a\{x) < 

Furthermore, it satisfies the property 

{W X such that u{x) < u^(x), 
Dtu^(u)(x)(-/(x))-/(x,/(x))-auT(x) < 

Remark — If the function u^ is differentiable, then the contingent epiderivative 
coincides with the usual derivatives, so that u^ is a solution to the linear Hamilton- 
Jacobi "differential variational inequalities" 

i) u(x) < u^(x) 

h) /^uT(x),/(a;)\+/(a;,/(x)) + au^(x) < 

Hi) (u(x) — u^(x)) ( — — u^(x), /(x) y + /(x, /(x)) + au^(x) I = 

Proof — By the Nagumo Theorem, the epigraph of v is viable under g if and 
only if 

y {x,y) e£p{v), {f{x),-ay-l{xj{x))) G T£p(v)(x,y) 

When y = v(x), we deduce from the fact that the contingent cone to the epigraph 
of V at (x, v(x)) 

T£p(^)ix,v{x)) := £p{D^v{x)) 
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that if the epigraph of v is viable under g, then 

VxGDom(v), D^^r{x){f{x)) + l{x,f{x)) + a^r{x) < 

Conversely, this inequality implies that (/(x), — av(x) —l{x, f{x))) G Tfp(v)(a;, v(x)). 
It also implies that ii y > v(x), {f{x),—ay — l{x,f{x))) belongs to T^p(v)(a;, y). 
Indeed, we know that there exist sequences /i„ > converging to 0, f„ converging 
to f{x) and e„ converging to such that 

{X + hnVn, V(x) - hn{a\{x) + l{x, /(x)) + knEn) G £^p(v) 

We thus deduce that 

(x + hnVn, y - hn{ay + /(x, /(x)) + /i„£:„) 

= (x + Kvn, v(x) - /i„(av(x) + Z(x, /(x)) + /i„£:„) + (0, (1 - K){y - v(x))) 

G ^p(v) + {0} X R+ = £p{y) 

and thus, that (/(x), —ay — /(x, /(x))) belongs to Tsp(y){x,y). 
Finally, Theorem |2.3.1| states that u^ satisfies 



V(x,u^(x)) G £:p(u'^)\9(£:p(u)), (-/(x),au^(x) +/(x, /(x))) G r£p(uT)(x, u^(x)) 

(4.2) 
which, joined to the other properties, can be translated as the "Frankowska" solution 
to the variational inequalities. □ 

4.2 Lyapunov Functions 

Consider a differential equation x' = /(x) and a nontrivial nonnegative lower semi- 
continuous extended function u : R" i-^ R+ U {+oo}. 
The function oX-qJu) : R" i-^ R+ U {+00} defined by 

«C/,o)H(a;) := inf (supe"*u(x(t))) 

is said to enjoy the a-Lyapunov property because for any initial state xq, there exists 
a solution to the differential equation x' = /(x) satisfying 

Vt>0, u(x(t)) < e-''^aJfQ){u){xo) (4.3) 

Such inequalities allow us to deduce many properties on the asymptotic behavior of 
V along the solutions to the differential equation. This may be quite useful when u 
is the distance function ciAf (■) to a subset. The domain of this Lyapunov function 
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aJpQ\{dM) provides the a-basin of attraction of M, which is the set of states from 
which a solution x(-) to the differential equation converges exponentially to M: 

Vxo G Dom(a(^o)((iA/)), dM{x{t)) < e~''^aJfQ^{dM)ixo) 

The main question we face is to characterize this Lyapunov function. Ever since 
Lyapunov proposed in 1892 his second method for studying the behavior of a solution 
around an equilibrium, finding Lyapunov functions for such and such differential 
equation has been a source of numerous problems requiring most often many clever 
tricks. 

We deduce from Theorems |4.1.1| and [4.1.2| with / = the following characteriza- 
tion of Lyapunov functions: 

Theorem 4.2.1 Let us assume that f is continuous with linear growth and that 
u : R" 1-^ R_|_ U {+00} is nontrivial, non negative and lower semicontinuous. Then 
the epigraph of the Lyapunov function aJr^Avi) is the viability kernel Viabg{Sp{u)) 
of the epigraph of u under g. Therefore, the Lyapunov function aJr^Ju) is the 
smallest of the nonnegative lower semicontinuous functions v : R" 1-^ R U {+C)o} 
enjoying the a-Lyapunov property, i.e., such that from any xq G Dom(v) starts at 
least one solution to the differential equation x' = f{x) satisfying 

Vt>0, v(x(t)) < v(xo)e~"* 

or, equivalently, 

L'|v(x)(/(x)) + av(x) < 

Furthermore, if u{x) < aJj^Juj^x), it satisfies 

D^OiJj^o){u){x){-f{x)) - aaJf^o){u){x) < 

4.3 Finite Length Solutions 

We define now l{x,p) := ||p||, so that l{x,f{x)) = ||/(a;)||, and take a := and 
u(a;) := 0. Then 

«(/,ll/ll)(0)(^o) = ,(./nf(,.)X ll^'(^)ll^^ 

is the minimal length of the trajectories of the solutions x(-) to the differential 
equation x' = f{x) starting from xq. 

Its epigraph is the viability kernel of R"' x R+ under the system of differential 
equations {x',y') = (/(x), — ||/(a;)||). The minimal length is the smallest of the 
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nonnegative lower semicontinuous functions v : R" i-^ R U {+00} satisfying for 
every x 

DMx)ifix)) + \\fix)\\ < 

and satisfies whenever the length a'ju-fJO){x) > is strictly positive 

D^al^^f^^{0){x){-fix))-\\f{x)\\< 

4.4 Stopping Time Problem 

We still consider the u : R" 1-^ R_|_ U {+00}, regarded as an "obstacle" in problems 
of unilateral mechanics. We associate with it the stopping time problem 

u^(x) := af^,o(u)(x) := inf (inf (e'^X^lt)) + re-/(x(r),x'(r))rfr)) 
'■■''' x(-)eSf(x) \t>o \ Jo J J 

We begin by characterizing its epigraph: 

Proposition 4.4.1 Let us assume that f and I are continuous with linear growth 
and thatu : R" 1-^ R+UJ+oo} is nontrivial, non negative and lower semicontinuous. 
Then the epigraph 0/ u^ := Q;frn(u) is the capture basin Capt (£p(u)) of the 
epigraph of u under g. 

Proof — To say that a pair {x,y) belongs to the capture basin Ca.ptg{Sp{u)) 
means that there exist a solution {x{-)) G S(^f){x) and t > such that 

(x{t),e~'''y- f e-^^'-U{x{T),x'{T))dT) e Sp{u) 
i.e., if and only if 



e"*u(a;(t))+ / e""/(a;(r),a;'(r))rfr < y 
Jo 



This implies that 



u (X) 



inf (M(e'''u(x(t))+ f\''U(x(T),x'(T))dT]] < y 

x{-)<-Sf(x) \t>0 \ Jo JJ ~ 

and thus, that Capt^(£^p(u)) is contained in Sp{u^). 
Since the infimum 

u^{x) := e"*u(x(t))+ f\''^l{x{T),x{T))dT 

Jo 
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is reached by a solution x{-) G Sf{x) at a time t, this states that {x, u^{x)) belongs 
to the capture basin of the epigraph of u. □ 

In order to apply the properties of capture basins, we need to check that X x R_|_ 
is a repeller under the auxiliary system g. 



Lemma 4.4.2 Let us assume that there exist real constants 7_ and 6 such that 

r i) inf.ex^ > 7-(lkll + l) 
\ ii) mi^^xKxJix)) > 64\\x\\ + l) 

and if a + '~f_^ > 0, then X x R_,_ is a repeller. 

Proof — Whenever / is nonnegative, the backward solutions (a;(-), |/(-)) starting 
from X X R+ are viable in X x R+ because y'{t) = —ay{t) + l{x{t)) > 0. 

Let (x(-), !/(■)) be the solution to the differential equation {x',y') = g{x,y) start- 
ing from {xo,yo). 

Therefore 



so that 

Vt>0, ||a:(t)|| > e^-*(||a:o|| + l)-l 

Furthermore, since 

/(x(r),x'(r)) > 5_(||x(r)|| + l) > 54||xo|| + l)e^-* 

and since 

e'^'yit) = yo- f e''^l{x{T))dT 
Jo 

we infer that 

JO 7_ + a ^ ^ 

Consequently, if 7 — h a > 

7- + a 7- + a 

so that y{t) becomes negative in finite time. □ 
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Theorem 4.4.3 We posit the assumptions of Proposition U-4-l\ o^'^^d we assume that 

p+oo 

WxeK, Wx(-)eSf(x), / e""/(x(r),x(r))rfr = +c 

Jo 



-oo 



Then u^ is characterized as the unique nonnegative lower semicontinuous func- 
tions V : R" 1-^ R U {+cxd} such that from any x satisfying \{x) < u{x) starts a 
solution x{-) e Sf{x) satisfying, for some time T > 

VtG [0,T], e"*v(x(t))+ / e""/(x(r),x'(r))rfr < v(x) 

Jo 

and that, for any T > and any xt G Doni(u), all solutions x{-) to the differential 
equation x' = f{x) arriving at xt at time T satisfy 

yte [0,T], e"*v(x(t))+ / e^U{x{T),x'{T))dT < v(s(0)) 

Jo 

The function u^ is also the smallest of the lower semicontinuous functions v satis- 
fying 

i i) < v(x) < u(a;) 

\ ii) if < v(a;) < u(a;), D^^^{x){f{x)) + l{xJ{x)) + a^^{x) < 

// we assume furthermore that f and I are Lipschitz, then the function u^ is the 
unique solution v > to the system of "differential inequalities": for every x G 
Doni(v), 

i) < v(x) < u(x) 

ii) if < v(x) < u(x), Z:'|v(x)(/(x)) + /(x) + av(x) < 

Hi) if < v(x) < u(x), D|v(x)(— /(x) — /(x), /(x)) — av(x) < 

Knowing the function u^ , the stopping time is the first time i > when v(x(t)) = 
u^(x(t)). 



Remark 



If the function u^ 



a 



(M 



[u) is differentiable, then the contingent 



epiderivative coincides with the usual derivatives, so that u is a solution to the 
linear Hamilton- Jacobi "differential variational inequalities" 



ii) 



< u-'-(x) < u(x 
/ d 



dx 



u^(x),/(x)\+/(x,/(x)) + au^(x) > 
d 



Hi) (u(x) — u (x)) M — — u (x), /(x) y + /(x, /(x)) + au (x) 
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Proof — Since the Lagrangian is nonnegative, the closed subset R" x R_|_ is 
backward invariant under g. It is a repeller under g whenever 

f + OO 

VxGR", Vx(-) g5/(x), / e""/(x(r),x'(r))dr = +00 



By Theorem |2.5.1| , Sp{u^) := Ca.ptg{Sp{u)) is the unique closed subset v, and in 



particular, the unique epigraph £^p(v) of lower semicontinuous function v, which 

satisfies 

i) Sp{u) C Sp{v) C R" X R+ 

a) Sp{'v)\Sp{u) is locally viable under g 
in) Sp{\) is backward invariant under g 

The first condition means that for any x G R", < v(x) < u(x) and we observe 
that {x,y) G Sp{'v)\£p(u) if and only if y G [v(x),u(x)[. Hence, the first statement 
of the theorem ensues. 

By Theorem |2.4.1| , Sp{u^) := Ca.pt JSp{u)) is also the smallest of the nonnega- 



tive lower semicontinuous v satisfying 

f i) Sp{u) C Sp{\) c R" X R+ 

\ ii) y {x,y) e£p{-v)\Sp{u), {f{x),-l{x,f{x))-ay) G T^p(v)(x,|/) 

When y = \{x), the second condition can be written 

if v(x) < u(x), -D|v(x) + av(x) + /(x, /(x)) < 

Conversely, this condition implies that for any y g]v(x), u(x)[, (/(x), — /(x, /(x)) 
ay) also belongs to T£p(v)(x, y) as in the proof of Theorem [4.1.2| . 



Since Sp{u ) = Capt^(£^p(u)) is the unique closed subset satisfying the above 
properties and being backward invariant under g, this implies that 

if v(x) < u(x), D|v(x)(— /(x) — Z(x), /(x)) — av(x) < 

The converse is true when / and / are Lipschitz, or whenever the solution to the 
system (x', y') = g{x, y) is unique. In this case, the function u-*- is the unique solution 
satisfying the two properties. □ 

4.5 Minimal Time and Minimal Length Solutions 

Let us consider a closed subset K C R" and ipK its indicator and take a = 0. 
We observe that the hitting time (or minimal time) function uj^ is equal to 

^K = (^f,li^K) 
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In the same way, we introduce the minimal length functional associating with 

^Kix(-)) := inf / ||a;'(s)||(is 
{t\x(t)eK}Jo 

the minimal length of the curve s i-^ x{s) from to t such that x{t) G K. We next 
define the "minimal length" function Xj^ by 

x{-)eSf{x) 



We note that 

So, these two functions enjoy the properties proved above. For instance: 



^K = "tllflK^-f 



f 

1. The minimal time function ujj^ is the smallest nonnegative lower semicontin- 

uous V function vanishing on K such that, 

yx^K, D^Y{x){f{x)) + l < 

If / is assumed furthermore to be Lipschitz, it is the unique nonnegative lower 
semi continuous solution vanishing on K satisfying the above inequalities and 

VxgR", D^Y{x){-f{x))-l < 

2. Assume that 

f + OO 

WxeR"", inf / \\x'(s)\\ds = +cx) 

xi-)&Sfix)Jo 

Then the minimal length function A;^ is the smallest nonnegative lower semi- 
continuous V function vanishing on K such that, 

Wx^K, D^^r{x){f{x)) + \\f{x)\\ < 

If / is assumed furthermore to be Lipschitz, it is the unique nonnegative lower 
semicontinuous solution vanishing on K satisfying the above inequalities and 

Va;eR^ DM^){-f{x))-\\f{x)\\ < 

Since the minimal time and minimal length functions coincide with the indicator 
of ipK on K, the above conditions imply that K is backward invariant under / 
whenever / is Lipschitz. 
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4.6 Viscosity Type Solutions 

We now use the characterizations in terms of normal cones for deriving the formu- 
lations in terms of subgradients instead of contingent epiderivatives. 

Theorem 4.6.1 We posit the assumptions of Theorem l^.l.^ . Then the value func- 
tion u^ is the solution to 

i) u{x) < u^(a;) 

ii) Wped-u^{x), {pj{x)) + l{x,f{x)) + au^{x) < 

and 

VpGDom(D|U^(x))-, {p,f{x)) <0 
Hi) Wped^u^{x), {u{x) -u^{x)) (^{p,f{x)) + l{x,f{x)) + au^{x)^ =0 

and 

y p e Bom{D^u^ (x))- , {u{x)-u^{x)){pj{x)) =0 

Such a solution, recently discovered independently by Frankowska and Barron & 
Jensen, are sometime called "bilateral solutions" to Hamilton- Jacobi equation 

(^u(x),/(x)\ + /(x,/(x)) + au(x) = 

The method we present here is due to Frankowska. 

Proof — By Theorem [4.1.2| , we know that whenever u(x) < u^(x). 



{f{x),-avJ{x) -l{x,f{x))) e T£p(uT)(a;,u^(x)) 
and that whenever u(x) < u^(x), 

{f{x),-au^{x)-l{xj{x))) e T£p(uT)(x,u^(x)) n-r^p(uT)(x,u^(a;)) 
Theorem |1.2.11| implies that these conditions are equivalent to 

V(p,A)eiV^p(,T)(x,u^(x)), (p,/(x))-A(au^(x) + /(x,/(x))) < 
whenever u(a;) < u^{x), and to 

V(p,A)eiV^p(„T)(x,u^(x)), (p,/(x))-A(au^(a;) + /(x,/(x))) = 

whenever u(a;) < u''"(a;). 

It remains now to recall that 

J i) {p, —1) G A'£-p(uT)(x, u^(x)) if and only if p G d^u^{x) 

[ ii) (p, 0) G A^£-p(uT)(x, u^(x)) if and only if p G Doin{Di^u^ (x))^ 
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Taking A = —1, we obtain 

yped-u^{x), {pJ{x))-X{au^{x) + l{xJ{x))) < 
and whenever u{x) < u^(x), 

VpG9_u^(x), {pJ{x))-X{au^{x) + l{xJ{x))) = 

Taking A = yields that for all p G Dom(D|U^(x))^, {p, f{x)) < if u(x) < vJ{x) 
and {p, f{x)) = if u{x) < vJ{x). This means that f{x) belongs to the closure of 
Doni(D|U^(a;)) in the general case and that x belongs to the vector space spanned 
by Dom.{D^u^ (x)) when u{x) < vJ{x). □ 

We obtain an analogous statement for the function u-*-: 
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Theorem 4.6.2 We posit the assumptions of Theorem \(. 4 -Sj - Then the value func- 
tion U"*- is the solution to 

i) < u^{x) < u{x) 

ii) VpGa_u^(x), (p,/(x)) + /(a;,/(a;)) + au^(a;) > 

and 

VpGDom(L)u[(x))", {pj{x)) >0 

VpG5_u^(x), (u(x) -u^(x))((p,/(x)) + /(x,/(x)) + au^(x)) =0 

and 

VpGDom(D|U^(x))", (u(x)-u^(x))(p,/(x)) =0 

Proof — By Theorem [4.4.3| , we know that whenever u(x) > u-'-(x), 

{-f{x),a\i^{x) + l{xj{x))) G T£p(uX)(a;,u-^(x)) 

and that whenever u(x) > u^(x), 

{f{x),-a\i^{x)-l{xj{x))) G T^p(u±)(x,u^(a;))n-T£p(uX)(x,u^(x)) 

Theorem |1.2.11| implies that these conditions are equivalent to whenever u(x) > 
u-'-(x), 

V(p,A)G Ar^p(„x)(x,u^(x)), (p,/(x))-A(au^(x) + /(x,/(x))) > 
and that whenever u(x) > u^(x), 

V(p, A) G A^fp(u±)(x, u^(x)), (p, /(x)) - A(au-^(a;) + /(x, /(x))) = 

It remains now to translate these statements in terms of subgradients. □ 

Remark: Viscosity Solutions — When we know a priori that the solution 
u"*- is continuous, we can prove that it is also a "viscosity solution" the the Hamilton- 
Jacobi variational inequalities: 
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Theorem 4.6.3 We posit the assumptions of Theorem \4-4-3i , and we assume that 
f and I are Lipschitz and the function u^ is continuous. Then the value function 
U"*- is the solution to 

i) < u-L(x) < u(x) 

a) W p ed+u-^{x), {-p,f{x))+l{x,f{x)) + au-^{x) > 

and 

VpeDom(DiU^)-, {pj{x)) <0 
Hi) Wped-u^{x), {pj{x)) + l{x,f{x)) + au^{x) < 
and 
VpG Dom(D^u^(x))-, {pj{x)) <0 

A solution to such a system of inequahties is called a 'viscosity solution' to Haniilton- 
Jacobi equation 



'_9_ 
dx 



n{x)J{x))+l{xJ{x)) + aM^{x) 







by Michael Crandall and Pierre-Louis Lions. 

Proof — We know that epigraph of u-*- is backward invariant under g. By 
Lemmas |1.7.2| and |1.7.3| , this implies that its complement is forward invariant under 
g, and, since / and / are Lipschitz, that its closure is also forward invariant. Since 
we assumed that u^ is continuous, the closure of the complement of the epigraph of 
u^ is the hypograph of u^. Therefore, 

V(a;,u-^(a;)) G Graph(u-^), {f{x),-a\i^{x)-l{xj{x))) E T^yp^^±^{x,u-^{x)) 

and thus, 

V {p, A) G N-Hyp(u^)ix, u^(x)), {p, f{x)) - A(au^(x) + /(x, /(x))) < 

It remains now to recall that 

J i) (p, 1) G NT-iyp(^u±-){x, u^{x)) if and only if p G 9+u^(x) 

I ii) {p, 0) G iV^j^p(u±)(x, u-'-(x)) if and only if Vp G Dom(Dj^u-'-(x))~ 

for deducing that the above condition is equivalent to 

Vj9G9+u^(x), {-p,f{x)) +au^{x)+l{x,f{x)) >0 

and that f{x) belongs to the closure of the domain of D)^u^{x) for achieving the 
proof. □ 
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Chapter 5 

Systems of First-Order Partial 
Differential Equations 



Introduction 



We study here Dirichlet boundary value problems for systems of first-order par- 
tial differential equations of the form 

d "^ (9 

Vj = l,...,P, —u{t,x) + ^--Ui{t,x)fi{t,x,u{t,x))-gj{t,x,u{t,x)) =0 
ot fr[ oxi 

on R+ X f], where Vt C R" is an open subset, F its boundary and K := Vt its closure. 
It is known that the solution U to the above system can be set- valued, describing 
"shocks". This is considered as a pathology whenever the solution is regarded as 
a map from the input space R+ x i^ to the output space R^, but is quite natural 
when the solution U is considered as a graph, i.e., a subset of R+ x K x IV and 
when the tools of set-valued analysis are used. Since we are looking for set-valued 
map solutions, we begin by introducing 

1. the graph of the upper graphical limit of a sequence of maps Un '■ X ^^ Y 
(single- valued or set- valued) is the upper limit of the graphs of f/„. 
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2. the contingent derivative DU{x,y) at point {x,y) of the graph of U is the 
upper graphical hmit of the difference quotients VhU{x,y), so that the graph 
of the contingent derivative is the contingent cone to the graph of U: 

GTaph{DU{x,y)) = TGraph(c/)(x,y) 

Introducing 

1. an initial data uq : K \^ R^, 

2. a boundary data vy : R+ x OK i-^ R*'. 

we shall prove the existence and the uniqueness of a set-valued solution : R+ x 
K ^^ RP to the system of first-order partial differential equations satisfying the 
initial/boundary- value conditions 

{ i) WxeK, uo{x) e U{0,x) , 

\ ii) \ft>0,\/xeT, vr{t,x) E U{t,x) ^ ' 

Again, the strategy is the same than the one we followed for Hamilton- Jacobi 
variational inequalities. It is enough to revive the method of characteristics by 
observing that the graph of the solution is the capture basin of the graph of the 
initial/boundary- value data under an auxiliary system (the "characteristic system"), 
use the characterizations derived from the Nagumo Theorem and the fact that the 
contingent cone to the graph is the graph of the contingent derivative of a set- valued 
map. 

However, the solution becomes single-valued when the maps /» depend only on 
the variables x. In this case, we even obtain explicit formulas. 

5.1 Contingent Derivatives of Set- Valued Maps 

5.1.1 Set- Valued Maps 

Definition 5.1.1 Let X and Y be two spaces. A set-valued map F from X to Y is 
characterized by its graph Graph{F) , the subset of the product space X xY defined 
by 

Graph(F) := {{x,y) eX xY \ y E F{x)} 

We shall say that F{x) is the image or the value of F at x. 
A set-valued map is said to be nontrivial if its graph is not empty, i.e., if there 
exists at least an element x E X such that F{x) is not empty. 
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We say that F is strict if all images F{x) are not empty. The domain of F is 
the subset of elements x E X such that F{x) is not empty: 

Dom(F) := {x E X \ F{x) ^ 0} 

The image of F is the union of the images (or values) F{x), when x ranges over X : 

Im(F) := U F{x) 
xex 

The inverse F^^ of F is the set-valued map from Y to X defined by 
xeF'^{y) ^^ y e F{x) ^^ (x, y) G Graph(F) 

We shall emphasize the characterization of a set-valued map (as well as a single- 
valued map) by its graph. This point of view has been coined the graphical approach 
by R.T. Rockafellar. 

The domain of F is thus the image of F^^ and coincides with the projection of 
the graph onto the space X and, in a symmetric way, the image of F is equal to the 
domain of F"^ and to the projection of the graph of F onto the space Y. 

Sequences of subsets can be regarded as set-valued maps defined on the set N of 
integers. 

5.1.2 Graphical Convergence of Maps 

Since the graphical approach consists in regarding closed set-valued maps as graphs, 
i.e., as closed subsets of the product space, ranging over the space JF(X x Y), one 
can supply this space with upper and lower limits, providing the concept of upper 
and lower graphical convergence: 

Definition 5.1.2 Let us consider metric spaces X, Y and a sequence of set-valued 
maps Fn : X ^^ Y . The set-valued maps Lim^n-^oo-^n o-iT'd Lim „^oo-^n from X to Y 
defined by 

i) Graph(Lim''„_^oo-^n) := Limsup„_,o^Graph(F„) 

ii) Graph(Lim''„_oo-^n) := Liminf„_^ooGraph(F„) 

are called the (graphical) upper and lower limits of the set-valued maps Fn respec- 
tively. 

Even for single-valued maps, this is a weaker convergence than the pointwise 
convergence: 
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Proposition 5.1.3 

1. If fn '■ X \-^ Y converges pointwise to f, then, for every x E X , f{x) G /"(x). 
If the sequence is equicontinuous, then /^(x) = {f{x)}. 

2. Let VL C R" he an open subset. If a sequence fn € ^{VL) converges to f in 
LP{n), then 

for almost all x E Vl, f(x) E f (x) 

5.1.3 Contingent Derivatives 

Let F : X -^^ y be a set-valued map. We introduce the differential quotients 

^ ^/ N/ N F(x + hu)—y 

h 

of a set- valued map F : X ^^ Y at {x,y) E Graph(F). 

Definition 5.1.4 The contingent derivative DF{x,y) of F at {x,y) E Graph(F) is 
the graphical upper limit of differential quotients: 

DF{x,y) := LimK^o+V hF{x,y) 

In other words, v belongs to DF[x,y){u) if and only if there exist sequences 
hn -^ 0+, Un ^ u and t>„ ^ t> such that Vra > 0, y + hnVn G F{x + /i„m„). 

In particular, if / : X h-> y is a single valued function, we set Df{x) = 
Df{xJ{x)). 

We deduce the fundamental formula on the graph of the contingent derivative: 

Proposition 5.1.5 The graph of the contingent derivative of a set-valued map is 
the contingent cone to its graph: for all {x,y) E Graph(F), 

Graph{DF{x,y)) = 7'Graph(F)(^'^) 

Proof — Indeed, we know that the contingent cone 

rr { \ J- Graph(F) - (x, y) 
^Graph{F)(^'^) = Lmisup^^o+ j^ 

is the upper limit of the differential quotients h when h -^ 0+. It is 

enough to observe that 

n \.fv7 171 \\ Graph(F) - (a;, y) 

Graph(V/,F(a;,t/)) = 

n 



Introduction 67 

and to take the upper limit to conclude. □ 

We can easily compute the derivative of the inverse of a set- valued map F (or 
even of a noninjective single- valued map): The contingent derivative of the inverse 
of a set-valued map F is the inverse of the contingent derivative: 

D{F-'){y,x) = DF{x,y)-' 

If if is a subset of X and / is a single- valued map which is Frechet differentiable 
around a point x & K, then the contingent derivative of the restriction of f to K 
the restriction of the derivative to the contingent cone: 



IS 



Dif\K)ix) = Dif\K)ix,fix)) = f'{x)\ 



Tk{x) 



5.2 Frankowska Solutions to First-Order Partial 
Differential Equations 

We consider two finite dimensional vector spaces R" and R^, an open subset Vt C R", 
its closure K := Vt closed, its boundary V := dQ = T, two time- dependent maps 
f : R+ X K X RP ^ R"" and g : R+ X K X RP ^ RP. 

We shall study the system of first-order partial differential equations 

d d 

—u{t,x) + —u{t,x)f{t,x,u{t,x))-g{t,x,u{t,x)) = (5.2) 

on R+ X K. 

It is known that the solution U to the above system can be set- valued, describing 
"shocks". This is considered as a pathology whenever the solution is regarded as 
a map from the input space R+ x K to the output space R^, but is quite natural 
when the solution U is considered as a graph, i.e., a subset of R+ x K x Rp and 
when the tools of set- valued analysis are used. 

Introducing 

1. an initial data mq : if ^— > R^, 

2. a boundary data fr : R+ x F i-^ R^. 

we shall prove the existence and the uniqueness of a solution : R+ xK ^^ to the sys- 
tem of first-order partial differential equations (^) satisfying the initial/boundary- 
value conditions 

{ i) yxeK, uoix) e U{0,x) 

\ ii) Vt>0, VxgF, vr{t,x) G U{t,x) ^ ' 
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Actually, we associate with the initial data Uq : K \-^ R^ and the boundary data 
vr : R+ X dK \-^ W the "extended" boundary data ^(■Uo^'^r) : 1^+ x K -^ Bf 
defined by 

{Uo{x) if s = & X E K 
vr{s,x) if s>0 & X e dK 
if s>0 & xelnt{K) 

which is a set-valued map since it takes (empty) set values, the domain of which is 
Dom(^(Mo,^^r)) := <9(R+ x K) = ({0} x K) U (R+ x T). 

The set-valued map \Ef encapsulates or replaces initial/boundary-value data. 
Hence initial and boundary conditions (p.3[) can be written in the form 



y{t,x) E R+xK, ^(Mo,fr)(t,x) C U{t,x) 

By the way, we can study as well the case when \E' : R+ x R" ^^ W is any 
set-valued map, which allows to study other problems than initial/boundary-value 
problems associated with the system of first-order partial differential equations ( |5.2| ). 

So, in the general case, we introduce two set-valued maps "^ : R+ x K ^^ R^ 
and $ : R+ x K ^^W satisfying 

V(t,a;) G R+ X ir, ^(t,a;) C ^{t,x) 

We shall prove the existence and the uniqueness of a solution : R+ x K '■^ io 
the system of first-order partial differential equations ( |5.2| ) satisfying the conditions 



V (t, x) G R+ X ir, ^(t,x) C U{t,x) C <l>(t,x) (5.4) 

The set-valued map $ describes "viability constraints" on the solution the so- 
lution U to the above system. The particular case without constraints is naturally 
obtained when $(t, x) := R^. 

Example: Impulse Boundary Value Problems This is the case when we 
provide boundary condition v^ only at impulse times tj of an increasing sequence of 
impulse times to = < ti ■ ■ ■ < t„ < ■ ■ ■. 

We associate with them the map \1' : R_|_ x K ^^ R^ only derived from the initial 
data uq : K ^^ R^ and the boundary data Vq^^ by 

{uq{x) ifs = k X e K 

vi{x) if s = ti, i > 0, & X G r 

if s G]ti,ti+i[,i > 0, k xeK 

defined on Dom(^(uo, {vdKY)) ■= ({0} x K) U [JiiiU} x T). D 
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We denote by h : R_,_ x K x W \-^ R" i-^ R+ x K x W \-^ R" the map defined 
by 

hiT,x,y) := {lJ{T,x,y),g{T,x,y)) 

and the associated system (r',x',y') = h{T,x,y) of differential equations 

.) r'{t) = 1 

zz) x'it) = /(r(t),x(t),y(t)) (5.5) 

m) y'(t) = (7(r(t),x(t),i/(t)) 

often called the associated "characteristic system" . 

Definition 5.2.1 Given two time- dependent maps f : R+ x K x R^ i-^ R" and 
g : R_|_ X K X W t^ W and two set-valued maps \E' : R+ x K ■-^ W and $ : 
R_i_ X K ^^ R'" satisfying 

V(t,x) G H+xK, ^{t,x) C $(t,x) 

we shall denote by U := Affg\{^) : R+ x /C -v^ Rp the set-valued map defined by 

Graph(f/) := Capt5f''^^^*^(Graph(^)) (5.6) 

the graph of which is the viable- capture basin under —h of the graph of ^ in the 
graph of $ . 

Even when \i/ is single-valued on its domain, this map U can take several values, 
defined as "shocks" in the language of physicists. 

Indeed, even though the trajectories of the solutions {x{t),y(t)) to the system of 
differential equation 

r z) x'{t) = f{t,x{t),y{t)) 
\ n) y'{t) = g{t,x{t),y{t)) 

never intersect in R" x R^, their projections x{t) onto R" — privileged in his role 
of input space — may do so. In other words, if Xi ^ X2, the solutions {xi(t),yi(t)) 
starting from the initial conditions {xi,uo{xi)) {i = 1,2) never intersect, but one 
cannot exclude the case when for some t, we may have xi{t) = X2{t). At this time, 
the solution U takes (at least) the values yi{t) ^ y2{t) associated with the common 
input X := Xi(t) = X2{t). 

However, U is single-valued whenever /(t, x, y) = fit, x) is independent of y and 
the above system has a unique solution for any initial condition. 

Theorems p.4.1| and |2.5.1| can be translated in terms of invariant manifold: 
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Definition 5.2.2 We shall say that a set-valued map V : R+ x K -^ W defines an 
invariant manifold under the pair {f, g) if for every to >0,XoEK andyo G V(to,Xo), 
every solution {x{-),y{-)) to the system of differential equations 

r t) x\t) = fit,xit),yit)) 
\ n) y'it) = g{t,x{t),y{t)) 

starting at (xci/o) ot time to satisfies 

Vt>to, y{t) G V{t,x{t)) 

We observe that V defines an invariant manifold under (/, g) if and only if the graph 
of V is invariant under h. 

Theorem 5.2.3 Let us assume that the maps f and g are continuous with linear 
growth and that the graphs of the set-valued maps \1' C $ are closed. The associated 
set-valued map U := Aft\{^) : R+ x K ^^ R^ defined by ( \5.(\ ) is the largest closed 
set-valued map enjoying the following properties: 

i. Vt>0, VxgK, ^(t,x) C U{t,x) C $(t,x) 

2. for every t,x and y G U (t , x)\'^ (t , x) , there exist s G [0,t[, Xg & K and 
ys G U{s, Xg) such that the solution to the above system of differential equations 
starting at {xs,u{s,x{s))) at time s satisfies 

VrG[s,t], yir) G U{T,x{r)), x{t) = x k y{t) = y 

If we assume furthermore that the set-valued map $ defines an invariant manifold 
under {f,g), then U is the unique set-valued map satisfying the above conditions, 
which also defines an invariant manifold under {f,g). 

Proof — By assumption, Graph(\E') is contained in Graph(<l>). The graphs 
of the maps $ and \E' are closed subsets and repellers since they are contained in 
R+ X K X R^, which is obviously a repeller under the map —h. 

Therefore, by Theorem |2. 4. 1| , Graph(f/) := Capt_;j (\E') is the largest closed 

subset D := Graph([/) satisfying 

J i) Graph(\Ef) C Graph(f/) C Graph($) 

1 ii) Graph(f/) \ Graph (\1') is locally viable under — h 

which are translated into the first properties of the above theorem. If we assume 
furthermore that $ defines an invariant manifold under {f,g), Theorem ^.5.1 



im- 



plies that Graph([/) = Capt_f^{^) is the unique closed subset satisfying the above 
properties and being backward invariant under —h, i.e., invariant under h. □ 
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Theorem |2.4.1| and |2.5.1| also allow us to derive the existence and the uniqueness 
of a set- valued map solution to the system of first-order partial differential equations 

d d 

—u{t,x) + —u{t,x)f{t,x,u{t,x))-g{t,x,u{t,x)) = 



satisfying the conditions ( |5.4|) 

V (t, x) G R+ X ir, <i/{t,x) C U{t,x) C $(t,x) 

Definition 5.2.4 We say that a set-valued map U : R4. x K \-^ W is a Frankowska 
solution to the problem ( ( \5 . 3i ) , 1 ^^ ) ) if the graph of U is closed and if 

i) \f {t,x) eR+x K,^y eU{t,x)\'${t,x), 

G DUit,x,y)i-l,-fit,x,y)) + git,x,y) 

and 
ii) V (t, x) G R+ X ir, V y G U{t, x), E DU{t, x, y)(l, f{t, x, y)) - git, x, y) 

Naturally, if \1/ := if) and U := u are single- valued on their domains, then a 
Frankowska solution can be written 

V (t, x) G Dom(M)\Dom(^), G Du{t, a;)(— 1, —fit, x, u(t, x))) + git, x, u(t, x)) 
< and 
^ Vt > 0, Vx G -ft', G Duit,x)il, fit,x,uit,x)) - git,x,uit,x)) 

If Duit, x)(— 1, — ^) = —Duit, x)(l, ^), these two equations boil down to only one 
of them on Dom(M)\Dom(^). If u is differentiable in the usual sense, it satisfies the 
above first order partial differential equation in the usual sense outside the domain 

of ip. 

Theorem 5.2.5 Let us assume that the maps f and g are continuous with linear 
growth and that the graphs of the set-valued maps \1' C $ are closed. 

Then the set-valued map U defined by i\5.6{ ) is the largest set-valued map with 
closed graph satisfying the condition 

V (t, x) G R+ X ir, ^(t,x) C Uit,x) C <l>(t,x) 
and solution to 

V(t,x)GR+xir, VyGf/(t,x)\^(t,x), G DUit,x,y)i-l,-fit,x,y))+git,x,y) 

If we assume furthermore that f and g are uniformly Lipschitz with respect to x 
and y and that <l> defines an invariant manifold under if,g), then U is the unique 
Frankowska solution to the problem (l \5.3i ), ^5^) ). 
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Proof— By Theorem |Xl|, Graph(t/) := Capt5f^P^^*^(Graph(^)) is the 
largest closed subset D := Graph(f/) satisfying 

i) Graph(\[^) C Graph(f/) C Graph($) 
ii) V {t,x,y) e Graph(f/)\Graph(^), 

-{lj{t,x,t),g{t,x,t)) e ^Graph(c/)(^'^'^) = Graph(L)f/)(t, x,?/) 

which can be translated 

V(t,x), \/yeU{t,x)\^{t,x), -g{t,x,y) e DUit,x,y){-l,-f{t,x,y)) 

If we assume furthermore that $ defines an invariant manifold under {f,g), Theo- 
rem |2.5.1| implies that Graph(f/) = Capt_;j(Graph(\l')) is the unique closed subset 
satisfying the above properties and being backward invariant under —h, i.e., invari- 
ant under h. This can be translated by stating that 

r \/{t,x,y) GGraph(f/), 

I (l,/(t,a;,t),^(t,x,t)) e 7'Qraph(C7)(^'^'^) = Graph{DU){t,x,y) 



I.e., 



\f{t,x)eR+xK,\/yEU{t,x), git,x,y) E DU{t,x,y){lJ{t,x,y)) 

5.3 Single- Valued Frankowska Solutions 

We already mentioned that even when ^ is single-valued on its domain, the solution 
U can take several values, defined as "shocks" in the language of physicists. 
However, single-valuedness is naturally preserved whenever 

h{T,x,y) := {l,ip{x),g{T,x,y)) 

when the second component of the map h does not depend upon the second variable 
y and the differential equation (r',x',?/') = h{T,x,y) has a unique solution for any 
initial condition. 

Therefore, we proceed with the specific case when f{t, x, y) = ip{x) depends only 
upon the variable x. 

When (t,x) G R+ x i^ is chosen, we introduce the function x{-) := -d^i^- — t,x) 
the solution to the differential equation x' = (p{x) starting at time at 'd^{—t, x), or 
arriving at x at time t. We associate with it the map g(t,x) '■ R+ x R^ '-^ R-*^ defined 
by 

\/ T>0, y eW, g(t,x)ir,y) := g{T,i9^{T - t,x),y) 
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We denote by -i^g,^^, (t, s,|/(s)) the value at t of the solution to the differential 
equation 

y'{r) = g(^t,x){r,y{T)) := ^(r,^^(r - t,a;),i/(r)) 

starting at y{s) associated with the evolution x{t) := {}^{t — t,x) starting at x{s) = 
"^ifiis — t, x) at initial time s. 

We associate with the backward exit function the map 0;^*^ defined by 

\/xeK, e/(x) := ^-^{tk'^{x),x) 

and we say that Q~^^ is the "exitor" (for exit projector) of K. It maps K to its 
boundary T and satisfies QJ^^^x) = x for every x G QJ^'^'^K). 

It will be very convenient to extend the function r^*^ defined on K to the function 
(again denoted by) Tj^''^ defined on R+ x K hj T]^'^{t,x) := min(t, rj^'^(x)): 

^-^u^^ ■=/ ^ if tG[0,r^^(x)] 

^ ^' ' • I r^^(x) if t G]r^^ (x),oo[ 

so that we can also extend the exitor map by setting 

0^'^(t,x) := ^_^(r^'^(t,a;),a;) G K 
because we observe that 6]^'^(t, x) is equal to 

r ^-^{t,x) if te [0,T^''{x)] 



eZ-'^ix) if tGlr 



''^( 



X , oo 



Proposition 5.3.1 We posit assumption 

K is closed and (forward) invariant under ip (5-7) 

and 

{i) Lp is Lipschitz and that g is continuous 
ii) (r'^x'^y') = h(T,x,y) has a unique solution for any initial condition 

(5.8) 
Let us introduce 

1. an initial data Uq : K \-^ W, 

2. a boundary data v^ : R+ x dK i-^ R^ 
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The solution u := ^(^^g)(\E'(Mo, Vr)) is the single-valued map with closed graph defined 
by 

uit.x) = ^9(,.)(^,i-^x^(i,a;),(^K,t;r)(t-r^''(t,a;),e/(t,x))) (5.9) 

or, more explicitly, by 

^g^^Jt,0,Uo{^-^{t,x))) if te[0,Tj,^x)] 

< 

Furthermore, if we assume the following viability assumptions on $ 

' i) VxeK, Vt>0, \/ye<^{t,x), g{t,x,y) e D<l>{t,x,y){l,if{x)) 
< ii) V^gT, Vt>0, vr{t,0 e ^t,^) 
Hi) y X e K, uo{x) e $(0,2;) 

(5.10) 
then 

\/ (t,x) eR+ X K, u{t,x) e $(t,x) 

Remark: — We stress the fact that the solution u{t,x) depends only 

1. upon the initial condition uo{x) when t < t^'^{x), 

2. upon the boundary condition Vr when t > r^'^(x). 

The second property proves a general principle concerning demographic evolution 
stating the state of the system eventually forgets its initial condition uq{-). 

Proof — We first take $(t,x) = R^, which is invariant by assumption ( |5.7| ). 
Then the graph of u is defined by ( |5.6| ) is equal to 

Graph([/) := Capt_/j(Graph(\l/(Mo,fr))) 

An element {t, x, y) of the graph of U is the value at some h > oi the solution 
(r(-),a;(-), ?/(■)) to the system of differential equations 

^) r'{t) = 1 

ii) x'{t) = (p{x{t)) 

III) y'{t) = giT{t),x{t),y{t)) 

starting from (s, c, \l/(uo, Vr){s, c))), assumed to be unique. 
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This implies that t = s + h and x = ^^{t, c). If s = 0, then t = h, x = 'd^it, c) 
and 

y = KJt,o,u{o,^.^{t,x))) 

If s > 0, then c G F, so that h = rj^'^{x), s = t — T^'^i.^) and c = Q^{x) and 

y = ^git,.)it^t~'^K'^i^)^^r{t-Tj^'^{x),Q2'{x))) 

Therefore, y =: u(t, x) is uniquely determined by t and x so that U =: u is single- 
valued. 



Assumptions ( 5.10 ) imply that the graph of the map (t, x) -^ <l>(t, x) is invariant 
under {l,ip,g) and that Graph(\l/„Q^^,j,) is contained in the graph of $. Hence the 
graph of u is contained in the graph of $. □ 

Example Let us consider a x-dependent matrix A{x) G £(R^,Rp). We asso- 
ciate the differential equation 

y'ir) = -A(x(r))|/(r) 

Then u{t,x) is equal to 

e-/o-4(''-(-*'--)'^-Mo(^-^(t,x)) if tG[0,r^'^(a;)] 

e ^'-^^^''^' Vv{t-T-^^{x),<$>~j^{x)) if tG]r^^(x),oo[ 



Example Let us consider the case when K : = /Ci x ■ ■ ■ x Kn here the Ki C R" 



are close subsets and set R" := n?=i R-" 



Lemma 5.3.2 Assume that K := YVj=i Kj is the product of n closed subsets Kj C 
R". We posit assumptions (\5.T{) on K. Denoting by 



the partial backward exit time functions, the backward exit time function can then be 
written 

r^'^(x) := min r^f(x) 

Proof — We observe that 

j\^i\\\{ka = u nRrx(R,"\^,)x n Rr 
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and thus, that for any function t \-^ x{t) = {xi(t), . . . , x„(t)), 



Tk{x{-)) := inf t = niin inf t 



2:(t)eR"\X j=l,...,n \xj{t)e'R"\Kj 



min TK^{xj{-)) 

j=l,...,n 



since the infimum on a finite union of subsets is the minimum of the infima on each 
subsets. □ 
In this case, 

(n \ n fj-l n 

ukA = u n^^xr.x n Ki 
j=l I j=l \i=l l=j+l 

so that the boundary data defined on T are defined by n maps 

i-i n 









Example For instance, let us consider the case when the four- dimensional 
causal variable x := {xi,X2,X3,X4^) ranges over the product K := nf=i -^i with 
Ki := R+, K2 := [0,r2], K3 := R+ and K^ := [0,6]. 

We are looking for solutions to the system of first-order partial differential equa- 
tions 

d d d d d 

Tru{t, x) + - — u{t, x) - p- — u{t, x) + a- — u{t, x) + fi{\) - x^Xt^- — u{t, x) 
at ox I 0x2 oxs 0x4 

= 9{t,x,u{t,x)) 

(where the scalars functions p, a and j3 are positive) satisfying the initial and 
boundary conditions 



i) Vxi >0, VxaG [0,r2], 0:3 > 0, X4 G [0,6], 

u{0,Xi,X2,Xs,X4) = Uo{Xi,X2,Xs,X4) 

ii) Vt > 0, Va;2 e [0,r2], X3 > 0, X4 e [0,6], 

u{t,0,X2,X^,X4) = Vi{t,X2,Xs,X4) 

i) Vt > 0, Vxi >0, xs >0, X4 G [0,6], 

u(t,Xi,r2,X3,X4) = Vr2(t,Xi,X3,X4) 



Hence, we derive the existence and the uniqueness of the Frankowska solution 
to the above system of partial differential equations satisfying an initial condition, 
a boundary condition for a;i = (births) and a boundary condition for X2 = T2. 
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For computing it, we need to know the backward exit time and the exitor for 
the associated characteristic system given by 



i) x[{t) = 1 

ii) X2(t) = —px2(t) 

in) x'^{t) = crx^lt) 

iv) x'^it) = P{b — X4(t))x4(t) 



(5.11^ 



where ip{x) := (v?i(x))j=i,...,4 with ipi{xi) := 1, ip2{x2) := -px2, ^Psixs) ■= o^x^ and 

(P4,{X4^) := P{b — X4)X4^. 

We recall that the solution to the purely logistic equation y'(t) = I3{t){h~y{t))y{t) 
starting at ys at time s is given by 

yit) ■■= — 



i + 'i-i>- 



-bf f3(T)dT 



The closed subset K is obviously (forward) invariant under y? defined by ip and 
one can observe easily that 



-^K^i.^) 



-oo & r^n^) 



-oo 



so that 



Therefore, 



r^^(t,a;i,a;2,a;3,X4) = min t,a;i,-log — 



P 



^2 



X2 



1. if t < min(a;i,Mog(^)), then 

QK^it.x) = \0,xi-t,e^*X2,e~''*X3, 



1 + (^-1)6/5"* 



2. if Xi < min ft, - log ( ^ ) ) , then 

e^'^(t,x) = |t-xi,0,e''^^X2,e-'^^^X3, 

3. if i log (^) < min (t, Xi) , then 



1 + (^ - l) 6/36^1 



t log ( — ) ,a;i log ( — ) ,r2,eV'-2 

P \X2/ P \X2/ 



X-i, 





h 


i+(i 


fib 
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If the right-hand side g{t,x,y) := —A{t,x)y where A{t,x) G £(R^,R^) is hnear, 
then we set 



A{t,x;T) := A lr,Xi-t + r,e-^(*-^)x2,e'"(*-^)x3, 



Then the solution is given by 

1. if t < min (xi, ^ log (^)) , then 



1 + (^ - l) e/5Kt-) 



2. if xi < min(t, Mog(^)), then 

3. if ^ log (^ j < min (t, Xi) , then 



l + (;^-lle/3^* 



1+fe-l)^ 



/3fezi 



u{t,x) = e p "^2^ 

f, 1, /r2\ 1 fr2\ (ff)" ^ 

t;,.^ t--log — ,a;i log — LeV^y xs, ^ 

I p Vx2/ p \X2/ i>(±_i](r^]T 

\ \Xi ) \X2) / 



5.4 Regularity Properties 

We begin by proving that the operator ^(ip,g) preserves continuity and boundedness: 



Proposition 5.4.1 We posit assumptions (\5.'1[ ) and \5.d^ ) and the regularity prop- 
erty 

t'^ : K ^^V is continuous (5.12) 

Assume also that g enjoys uniform linear growth with respect to y in the sense that 
there exists a positive constant c such that 



^xeK, VyGR^ \\git,x,y)\\ < cil + \\y\ 



(5.13) 



Then the A(^ip^g){'^{uo,vr)) is continuous and bounded whenever Uq and vr are con- 
tinuous and bounded. 
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Proof — By assumption ( p.l2| ), TK{t,x) := min(t, r;^'^(x)) is also continuous, 
so that 9^'^(t, x) := '(9_<^(r^'''(t, x),x) is also continuous, and thus 

u{t,x) = 'dg^^^^^{t,t - TKit,x),'^{uo,vr)it - TKit,x),QK'^{t,x))) 

is also continuous. When ||(yf(t,x, |/)|| < c(l + \\y\\), we also infer that 

Mt,x)\\ < e^-^'(*'^Vax(l|wo(x)||,||t;r(e^^(a:))||) 



and thus, that 



\\uit,-)\\oc < e'' max(||Mo||oo, ll^^rlloo) 

Next, we prove that under monotonicity assumptions, the operator A[^^g) is 
Lipschitz: 

Definition 5.4.2 We say that g is uniformly monotone with respect to t and y if 
there exists fj, eH such that 

{9it,x,yi)- g{t,x,y2),yi-y2) < -fJ'\\yi-y2f (5.14) 

The interesting case is obtained when /i > 0. When g is uniformly Lipschitz with 
respect to t and y with constant A, then it is uniformly monotone with /i = —A. 

Proposition 5.4.3 We posit assumption l \5.'^ and assume that (p is Lipschitz and 
that g is continuous and that g is uniformly monotone with respect to y. 
Then, for each t > 0, 

' sup^ei^ \\{A^^^g)^{ul,v^)){{t,x) - {A^^^g)^{ulvl){t,x)\\ 
< e-^'^max{\\ul-ul\\oo,\Kitr) - ^r)(^> OIU) 



Consequently, if we posit assumptions ( \5.13i ) and l\5.1di ), we deduce that for any 
T>0 

A(^,g) : Coo(K,R^) X Coo([0,T] X r,RP) ^ Coo([0,r] X K,W) 

is a Lipschitz operator from the space Coo{K,W) x Coo([0,T] x F, R^) of pairs of 
continuous and bounded initial and boundary data to the space Coo([0,r] x K, R^) 
of continuous and bounded maps from [0,T] x K to W. 

Proof — Indeed, setting u'it.x) := (^(<^_g)(\l'(uQ,fp)))(a;), z = 1,2, we know 
that 

-ixeK, u\t,x) := t9g,,^(t,t-r^'^(t,x),vI/K,t;^)(e]^^(t,x))) 
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is the value ?/*(t) := u\t, x) at time t of the solution y{-) to the differential equation 
l/'(r) = g{T,x{T),y{T)) starting from \l/(MQ,fp)(9]^'''(t,a;)) at time t— r^'''(t,x), where 
x(-) is the solution to the differential equation x' = f{x) starting from ©^"^(t, x) at 
time t — T^'^{t,x). 



Recalling that Tp^'^{t,x) = min(t, r^'''(x)) < t, we infer from assumption ( 5.14 ) 
thatQ 

mt)-y\t)\\ 

< e-^'-K''(t,-)\\xi,(ulvl){ej/{t,x)) - ^{ulvl^){eK''{t,x))\\ 



< e ^* max(sup^,g^' 



1^0(2;) -ul{x) 



e ^* maxf 



Un 



M, 



Oiloo 



+ m 



2 I 

'^r 1 00 ) 



supper II ^f(0-^ax (Oil) 



^Indeed, integrating the two sides of inequality 



-J\yi{t) - y2m^ = 2{g{t,xit),y,{t))-g{t,x{t),y2{t)),yiit)~y2it)) < -2/i||yi(i) - ^2 Wf 

||yiW-2/2Wf < e-2^'*l|yi(0)-2/2(0)f 



dt 
yields 
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